[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:19:11 dist-test-slave-w206 krb5kdc[11646](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:19:11 dist-test-slave-w206 krb5kdc[11646](info): set up 2 sockets
Aug 09 02:19:11 dist-test-slave-w206 krb5kdc[11646](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260809 02:19:12.861490 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:19:12 dist-test-slave-w206 krb5kdc[11646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241952, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:19:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:19:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:19:12.986466 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:45863
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:34539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:45863
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:13.072801 11659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:13.073083 11659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:13.073130 11659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:13.074314 11659 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:19:13.074395 11659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:13.074424 11659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:13.074457 11659 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:19:13.074492 11659 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:19:13.076120 11659 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:34539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:45863
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:45863
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11659
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:13.076550 11659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:13.076857 11659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:13.083813 11665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:13.083917 11659 server_base.cc:1034] running on GCE node
W20260809 02:19:13.084059 11664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:13.085471 11667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:13.085785 11659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:13.086143 11659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:13.087313 11659 hybrid_clock.cc:648] HybridClock initialized: now 1786241953087303 us; error 54 us; skew 500 ppm
Aug 09 02:19:13 dist-test-slave-w206 krb5kdc[11646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241953, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:13.090050 11659 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:19:13.090718 11659 webserver.cc:460] Webserver started at http://127.11.93.190:39851/ using document root <none> and password file <none>
I20260809 02:19:13.091091 11659 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:13.091172 11659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:13.091334 11659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:13.092579 11659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "5f866f204afd47059b5a063c02c17ecc"
format_stamp: "Formatted at 2026-08-09 02:19:13 on dist-test-slave-w206"
server_key: "e6aa9f48368184e33161e2bb4c42ca31"
server_key_iv: "3323947df85289633622773ff4cb4c77"
server_key_version: "encryptionkey@0"
I20260809 02:19:13.092963 11659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "5f866f204afd47059b5a063c02c17ecc"
format_stamp: "Formatted at 2026-08-09 02:19:13 on dist-test-slave-w206"
server_key: "e6aa9f48368184e33161e2bb4c42ca31"
server_key_iv: "3323947df85289633622773ff4cb4c77"
server_key_version: "encryptionkey@0"
I20260809 02:19:13.094789 11659 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:19:13.095993 11674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:13.096293 11659 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:13.096453 11659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "5f866f204afd47059b5a063c02c17ecc"
format_stamp: "Formatted at 2026-08-09 02:19:13 on dist-test-slave-w206"
server_key: "e6aa9f48368184e33161e2bb4c42ca31"
server_key_iv: "3323947df85289633622773ff4cb4c77"
server_key_version: "encryptionkey@0"
I20260809 02:19:13.096537 11659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:13.108522 11659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:13.110956 11659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:13.111236 11659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:13.116421 11659 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:45863
I20260809 02:19:13.116499 11729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:45863 every 8 connection(s)
I20260809 02:19:13.117116 11659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:19:13.118676 11730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:13.122306 11730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f866f204afd47059b5a063c02c17ecc: Bootstrap starting.
I20260809 02:19:13.122407 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 11659
I20260809 02:19:13.122563 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:19:13.123242 11638 external_mini_cluster.cc:1428] Setting key cc80b5621cabaec91b4bc8916668e01b
I20260809 02:19:13.123489 11730 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f866f204afd47059b5a063c02c17ecc: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:13.123914 11730 log.cc:824] T 00000000000000000000000000000000 P 5f866f204afd47059b5a063c02c17ecc: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:13.125303 11730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f866f204afd47059b5a063c02c17ecc: No bootstrap required, opened a new log
I20260809 02:19:13.127704 11730 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f866f204afd47059b5a063c02c17ecc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f866f204afd47059b5a063c02c17ecc" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45863 } }
I20260809 02:19:13.127974 11730 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f866f204afd47059b5a063c02c17ecc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:13.128116 11730 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f866f204afd47059b5a063c02c17ecc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f866f204afd47059b5a063c02c17ecc, State: Initialized, Role: FOLLOWER
I20260809 02:19:13.128350 11730 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f866f204afd47059b5a063c02c17ecc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f866f204afd47059b5a063c02c17ecc" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45863 } }
I20260809 02:19:13.128458 11730 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f866f204afd47059b5a063c02c17ecc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:19:13.128590 11730 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f866f204afd47059b5a063c02c17ecc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:19:13.128716 11730 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f866f204afd47059b5a063c02c17ecc [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:13.129419 11730 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f866f204afd47059b5a063c02c17ecc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f866f204afd47059b5a063c02c17ecc" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45863 } }
I20260809 02:19:13.129678 11730 leader_election.cc:302] T 00000000000000000000000000000000 P 5f866f204afd47059b5a063c02c17ecc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f866f204afd47059b5a063c02c17ecc; no voters:
I20260809 02:19:13.129962 11730 leader_election.cc:288] T 00000000000000000000000000000000 P 5f866f204afd47059b5a063c02c17ecc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:19:13.130025 11735 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f866f204afd47059b5a063c02c17ecc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:13.130189 11735 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f866f204afd47059b5a063c02c17ecc [term 1 LEADER]: Becoming Leader. State: Replica: 5f866f204afd47059b5a063c02c17ecc, State: Running, Role: LEADER
I20260809 02:19:13.130523 11735 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f866f204afd47059b5a063c02c17ecc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f866f204afd47059b5a063c02c17ecc" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45863 } }
I20260809 02:19:13.130539 11730 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f866f204afd47059b5a063c02c17ecc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:19:13.131532 11736 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f866f204afd47059b5a063c02c17ecc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f866f204afd47059b5a063c02c17ecc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f866f204afd47059b5a063c02c17ecc" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45863 } } }
I20260809 02:19:13.131618 11736 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f866f204afd47059b5a063c02c17ecc [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:13.131840 11737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f866f204afd47059b5a063c02c17ecc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f866f204afd47059b5a063c02c17ecc. Latest consensus state: current_term: 1 leader_uuid: "5f866f204afd47059b5a063c02c17ecc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f866f204afd47059b5a063c02c17ecc" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45863 } } }
I20260809 02:19:13.131965 11737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f866f204afd47059b5a063c02c17ecc [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:13.132211 11744 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:19:13.133342 11744 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:19:13.135999 11744 catalog_manager.cc:1347] Generated new cluster ID: 7d58d568ee29447faccb51d59421a645
I20260809 02:19:13.136121 11744 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 02:19:13 dist-test-slave-w206 krb5kdc[11646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241952, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:13.144940 11733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:13.124559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59678 (local address 127.11.93.190:45863)
0809 02:19:13.124916 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:13.124928 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:13.125126 (+ 198us) server_negotiation.cc:407] Connection header received
0809 02:19:13.128091 (+ 2965us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:13.128101 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:13.128211 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:13.128407 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:13.130329 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:13.131882 (+ 1553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:13.133693 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:13.134466 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:13.134585 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:13.140084 (+ 5499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:13.140089 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:13.140090 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:13.140104 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:13.142387 (+ 2283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:13.143047 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:13.143051 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:13.143051 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:13.143188 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:13.143504 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:13.143505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:13.143505 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:13.143985 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:13.144207 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:13.144486 (+ 279us) server_negotiation.cc:299] Negotiation successful
0809 02:19:13.144692 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":92,"threads_started":1}
I20260809 02:19:13.147822 11744 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:19:13.148631 11744 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:19:13.154304 11744 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f866f204afd47059b5a063c02c17ecc: Generated new TSK 0
I20260809 02:19:13.154528 11744 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.93.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
I20260809 02:19:13.189787 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:45863
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:34539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:13.274115 11757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:13.274371 11757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:13.274412 11757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:13.275679 11757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:13.275750 11757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:13.275797 11757 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:19:13.277329 11757 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:34539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:45863
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:13.277603 11757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:13.277839 11757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:13.283521 11762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:13.283506 11763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:13.283493 11767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:13.284036 11757 server_base.cc:1034] running on GCE node
I20260809 02:19:13.284304 11757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:13.284621 11757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:13.285802 11757 hybrid_clock.cc:648] HybridClock initialized: now 1786241953285789 us; error 28 us; skew 500 ppm
Aug 09 02:19:13 dist-test-slave-w206 krb5kdc[11646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241953, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:13.288936 11757 init.cc:377] Logged in from keytab as kudu/127.11.93.129@KRBTEST.COM (short username kudu)
I20260809 02:19:13.289448 11757 webserver.cc:460] Webserver started at http://127.11.93.129:43775/ using document root <none> and password file <none>
I20260809 02:19:13.289685 11757 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:13.289749 11757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:13.289912 11757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:13.291023 11757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "c63ec37cafca4093aa987b45a3a1fb57"
format_stamp: "Formatted at 2026-08-09 02:19:13 on dist-test-slave-w206"
server_key: "e91a25a8a123fe6f8e796d1566c5fa4b"
server_key_iv: "d57fb317dc00c5e08a3d1975109d74e2"
server_key_version: "encryptionkey@0"
I20260809 02:19:13.291409 11757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "c63ec37cafca4093aa987b45a3a1fb57"
format_stamp: "Formatted at 2026-08-09 02:19:13 on dist-test-slave-w206"
server_key: "e91a25a8a123fe6f8e796d1566c5fa4b"
server_key_iv: "d57fb317dc00c5e08a3d1975109d74e2"
server_key_version: "encryptionkey@0"
I20260809 02:19:13.292829 11757 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:13.293653 11774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:13.293830 11757 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:13.293936 11757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "c63ec37cafca4093aa987b45a3a1fb57"
format_stamp: "Formatted at 2026-08-09 02:19:13 on dist-test-slave-w206"
server_key: "e91a25a8a123fe6f8e796d1566c5fa4b"
server_key_iv: "d57fb317dc00c5e08a3d1975109d74e2"
server_key_version: "encryptionkey@0"
I20260809 02:19:13.294010 11757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:13.325299 11757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:13.327865 11757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:13.328048 11757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:13.328390 11757 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:13.328811 11757 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:13.328915 11757 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:13.328962 11757 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:13.328989 11757 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:13.335695 11757 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:41409
I20260809 02:19:13.335754 11893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:41409 every 8 connection(s)
I20260809 02:19:13.336086 11757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
Aug 09 02:19:13 dist-test-slave-w206 krb5kdc[11646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241953, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:13.345639 11733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:13.337013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:39973 (local address 127.11.93.190:45863)
0809 02:19:13.337083 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:13.337085 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:13.337281 (+ 196us) server_negotiation.cc:407] Connection header received
0809 02:19:13.337804 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:13.337805 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:13.337819 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:13.337881 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:13.338928 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:13.339498 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:13.340522 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:13.340752 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:13.340830 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:13.343075 (+ 2245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:13.343076 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:13.343076 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:13.343083 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:13.344404 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:13.344788 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:13.344789 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:13.344789 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:13.344842 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:13.345054 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:13.345055 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:13.345055 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:13.345158 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:13.345258 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:13.345490 (+ 232us) server_negotiation.cc:299] Negotiation successful
0809 02:19:13.345570 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 02:19:13.345829 11896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:13.336960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45863 (local address 127.11.93.129:39973)
0809 02:19:13.337125 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:13.337169 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:13.337683 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:13.337959 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:13.337962 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:13.338589 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:13.338798 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:13.338803 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:13.339612 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:13.339613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:13.340417 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:13.340419 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:13.340837 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:13.340838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:13.340961 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:13.341529 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:13.341538 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:13.342947 (+ 1409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:13.344485 (+ 1538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:13.344492 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:13.344494 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:13.344723 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:13.344900 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:13.344900 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:13.344901 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:13.345001 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:13.345258 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:13.345263 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:13.345378 (+ 115us) client_negotiation.cc:769] Sending connection context
0809 02:19:13.345460 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 02:19:13.345579 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":93,"threads_started":1}
I20260809 02:19:13.346189 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 11757
I20260809 02:19:13.346285 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:19:13.346462 11638 external_mini_cluster.cc:1428] Setting key c3300f828b09d445a453473f4cefd061
I20260809 02:19:13.346480 11894 heartbeater.cc:347] Connected to a master server at 127.11.93.190:45863
I20260809 02:19:13.346573 11894 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:13.346767 11894 heartbeater.cc:511] Master 127.11.93.190:45863 requested a full tablet report, sending...
I20260809 02:19:13.347870 11693 ts_manager.cc:194] Registered new tserver with Master: c63ec37cafca4093aa987b45a3a1fb57 (127.11.93.129:41409)
I20260809 02:19:13.348847 11693 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:39973
WARNING: no policy specified for kudu/127.11.93.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
I20260809 02:19:13.374784 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:45863
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:34539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:13.457837 11900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:13.458037 11900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:13.458060 11900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:13.459208 11900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:13.459249 11900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:13.459276 11900 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:19:13.460688 11900 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:34539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:45863
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11900
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:13.460867 11900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:13.461040 11900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:13.466181 11906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:13.466228 11908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:13.466233 11905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:13.466555 11900 server_base.cc:1034] running on GCE node
I20260809 02:19:13.466773 11900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:13.467054 11900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:13.468207 11900 hybrid_clock.cc:648] HybridClock initialized: now 1786241953468198 us; error 29 us; skew 500 ppm
Aug 09 02:19:13 dist-test-slave-w206 krb5kdc[11646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241953, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:13.470824 11900 init.cc:377] Logged in from keytab as kudu/127.11.93.130@KRBTEST.COM (short username kudu)
I20260809 02:19:13.471331 11900 webserver.cc:460] Webserver started at http://127.11.93.130:46225/ using document root <none> and password file <none>
I20260809 02:19:13.471570 11900 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:13.471649 11900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:13.471808 11900 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:13.472913 11900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "00adb5d649e44d0c914629b888a8ef21"
format_stamp: "Formatted at 2026-08-09 02:19:13 on dist-test-slave-w206"
server_key: "8ea50e0e2c65cd26d5048354741f738a"
server_key_iv: "1c3921b302decfb917b44680adbf3ea6"
server_key_version: "encryptionkey@0"
I20260809 02:19:13.473318 11900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "00adb5d649e44d0c914629b888a8ef21"
format_stamp: "Formatted at 2026-08-09 02:19:13 on dist-test-slave-w206"
server_key: "8ea50e0e2c65cd26d5048354741f738a"
server_key_iv: "1c3921b302decfb917b44680adbf3ea6"
server_key_version: "encryptionkey@0"
I20260809 02:19:13.474735 11900 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:19:13.475625 11915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:13.475804 11900 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:13.475905 11900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "00adb5d649e44d0c914629b888a8ef21"
format_stamp: "Formatted at 2026-08-09 02:19:13 on dist-test-slave-w206"
server_key: "8ea50e0e2c65cd26d5048354741f738a"
server_key_iv: "1c3921b302decfb917b44680adbf3ea6"
server_key_version: "encryptionkey@0"
I20260809 02:19:13.475989 11900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:13.501708 11900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:13.503780 11900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:13.503953 11900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:13.504197 11900 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:13.504515 11900 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:13.504573 11900 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:13.504614 11900 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:13.504642 11900 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:13.510609 11900 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:34189
I20260809 02:19:13.510702 12031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:34189 every 8 connection(s)
I20260809 02:19:13.511063 11900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
Aug 09 02:19:13 dist-test-slave-w206 krb5kdc[11646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241953, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:13.520602 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 11900
I20260809 02:19:13.520704 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:19:13.520725 11733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:13.511876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:57597 (local address 127.11.93.190:45863)
0809 02:19:13.511933 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:13.511935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:13.512140 (+ 205us) server_negotiation.cc:407] Connection header received
0809 02:19:13.512651 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:13.512652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:13.512664 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:13.512720 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:13.513677 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:13.514173 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:13.515171 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:13.515400 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:13.515465 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:13.517706 (+ 2241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:13.517707 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:13.517708 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:13.517716 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:13.519267 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:13.519640 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:13.519641 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:13.519641 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:13.519694 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:13.519953 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:13.519954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:13.519955 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:13.520082 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:13.520148 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:13.520484 (+ 336us) server_negotiation.cc:299] Negotiation successful
0809 02:19:13.520588 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 02:19:13.520748 12034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:13.511846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45863 (local address 127.11.93.130:57597)
0809 02:19:13.512015 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:13.512050 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:13.512529 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:13.512783 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:13.512786 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:13.513379 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:13.513585 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:13.513589 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:13.514257 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:13.514257 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:13.515089 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:13.515092 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:13.515484 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:13.515485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:13.515586 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:13.516091 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:13.516100 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:13.517607 (+ 1507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:13.519339 (+ 1732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:13.519346 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:13.519348 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:13.519574 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:13.519753 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:13.519754 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:13.519754 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:13.519862 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:13.520151 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:13.520156 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:13.520280 (+ 124us) client_negotiation.cc:769] Sending connection context
0809 02:19:13.520385 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 02:19:13.520521 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":108,"threads_started":1}
I20260809 02:19:13.520895 11638 external_mini_cluster.cc:1428] Setting key a48f2424064fe70cff2ea97e5e3559a0
I20260809 02:19:13.521312 12032 heartbeater.cc:347] Connected to a master server at 127.11.93.190:45863
I20260809 02:19:13.521423 12032 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:13.521649 12032 heartbeater.cc:511] Master 127.11.93.190:45863 requested a full tablet report, sending...
I20260809 02:19:13.522084 11693 ts_manager.cc:194] Registered new tserver with Master: 00adb5d649e44d0c914629b888a8ef21 (127.11.93.130:34189)
I20260809 02:19:13.522487 11693 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:57597
WARNING: no policy specified for kudu/127.11.93.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
I20260809 02:19:13.547498 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:45863
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:34539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:13.633433 12037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:13.633688 12037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:13.633729 12037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:13.634856 12037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:13.634923 12037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:13.634968 12037 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:19:13.636475 12037 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:34539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:45863
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12037
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:13.636762 12037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:13.637002 12037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:13.641939 12044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:13.641939 12045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:13.641970 12037 server_base.cc:1034] running on GCE node
W20260809 02:19:13.641974 12047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:13.642426 12037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:13.642678 12037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:13.643841 12037 hybrid_clock.cc:648] HybridClock initialized: now 1786241953643819 us; error 55 us; skew 500 ppm
Aug 09 02:19:13 dist-test-slave-w206 krb5kdc[11646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241953, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:13.646369 12037 init.cc:377] Logged in from keytab as kudu/127.11.93.131@KRBTEST.COM (short username kudu)
I20260809 02:19:13.646799 12037 webserver.cc:460] Webserver started at http://127.11.93.131:45637/ using document root <none> and password file <none>
I20260809 02:19:13.647083 12037 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:13.647151 12037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:13.647305 12037 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:13.648413 12037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "bbcdffef164d428abf5a1cf0b92df3a7"
format_stamp: "Formatted at 2026-08-09 02:19:13 on dist-test-slave-w206"
server_key: "3c89e5fa793c31070a59aae0bdfb4f23"
server_key_iv: "44d3affcc0004c19701d93621eb90a26"
server_key_version: "encryptionkey@0"
I20260809 02:19:13.648784 12037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "bbcdffef164d428abf5a1cf0b92df3a7"
format_stamp: "Formatted at 2026-08-09 02:19:13 on dist-test-slave-w206"
server_key: "3c89e5fa793c31070a59aae0bdfb4f23"
server_key_iv: "44d3affcc0004c19701d93621eb90a26"
server_key_version: "encryptionkey@0"
I20260809 02:19:13.650100 12037 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:19:13.650846 12055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:13.651054 12037 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:19:13.651166 12037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "bbcdffef164d428abf5a1cf0b92df3a7"
format_stamp: "Formatted at 2026-08-09 02:19:13 on dist-test-slave-w206"
server_key: "3c89e5fa793c31070a59aae0bdfb4f23"
server_key_iv: "44d3affcc0004c19701d93621eb90a26"
server_key_version: "encryptionkey@0"
I20260809 02:19:13.651321 12037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:13.661749 12037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:13.663940 12037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:13.664106 12037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:13.664345 12037 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:13.664669 12037 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:13.664726 12037 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:13.664767 12037 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:13.664795 12037 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:13.670492 12037 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:46609
I20260809 02:19:13.670580 12175 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:46609 every 8 connection(s)
I20260809 02:19:13.670908 12037 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:19:13.672937 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 12037
I20260809 02:19:13.673007 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:19:13.673172 11638 external_mini_cluster.cc:1428] Setting key 16a3cfd053161b2d207380ca97d16509
Aug 09 02:19:13 dist-test-slave-w206 krb5kdc[11646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241953, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:13.681607 11733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:13.671739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:57193 (local address 127.11.93.190:45863)
0809 02:19:13.671826 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:13.671829 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:13.672016 (+ 187us) server_negotiation.cc:407] Connection header received
0809 02:19:13.672688 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:13.672689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:13.672706 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:13.672785 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:13.674379 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:13.675111 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:13.676239 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:13.676422 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:13.676473 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:13.678850 (+ 2377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:13.678851 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:13.678851 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:13.678858 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:13.680414 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:13.680816 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:13.680816 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:13.680817 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:13.680868 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:13.681083 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:13.681084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:13.681084 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:13.681187 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:13.681239 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:13.681479 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 02:19:13.681540 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 02:19:13.681807 12178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:13.671628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45863 (local address 127.11.93.131:57193)
0809 02:19:13.671859 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:13.671913 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:13.672552 (+ 639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:13.672864 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:13.672868 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:13.673808 (+ 940us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:13.674210 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:13.674218 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:13.675243 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:13.675244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:13.676148 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:13.676151 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:13.676516 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:13.676517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:13.676629 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:13.677129 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:13.677138 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:13.678765 (+ 1627us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:13.680488 (+ 1723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:13.680494 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:13.680496 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:13.680730 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:13.680924 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:13.680925 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:13.680925 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:13.681025 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:13.681253 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:13.681258 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:13.681369 (+ 111us) client_negotiation.cc:769] Sending connection context
0809 02:19:13.681453 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 02:19:13.681570 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":111,"threads_started":1}
I20260809 02:19:13.682322 12176 heartbeater.cc:347] Connected to a master server at 127.11.93.190:45863
I20260809 02:19:13.682405 12176 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:13.682612 12176 heartbeater.cc:511] Master 127.11.93.190:45863 requested a full tablet report, sending...
I20260809 02:19:13.683125 11693 ts_manager.cc:194] Registered new tserver with Master: bbcdffef164d428abf5a1cf0b92df3a7 (127.11.93.131:46609)
I20260809 02:19:13.683521 11693 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:57193
I20260809 02:19:13.685654 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 02:19:13 dist-test-slave-w206 krb5kdc[11646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241953, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 02:19:13 dist-test-slave-w206 krb5kdc[11646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241953, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.93.129@KRBTEST.COM
I20260809 02:19:13.710806 12184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:13.703132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59268 (local address 127.11.93.129:41409)
0809 02:19:13.703345 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:13.703350 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:13.703361 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:19:13.703388 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:13.703390 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:13.703404 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:13.703479 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:13.704035 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:13.704767 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:13.705481 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:13.705844 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:13.705914 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:13.708234 (+ 2320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:13.708242 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:13.708242 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:13.708249 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:13.709713 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:13.710037 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:13.710040 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:13.710040 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:13.710098 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:13.710270 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:13.710271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:13.710271 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:13.710417 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:13.710531 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:13.710595 (+ 64us) server_negotiation.cc:299] Negotiation successful
0809 02:19:13.710660 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":95,"threads_started":1}
W20260809 02:19:13.711360 11804 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59268
Aug 09 02:19:13 dist-test-slave-w206 krb5kdc[11646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241953, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 02:19:13 dist-test-slave-w206 krb5kdc[11646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241953, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.129@KRBTEST.COM
I20260809 02:19:13.734615 12184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:13.727681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59272 (local address 127.11.93.129:41409)
0809 02:19:13.727745 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:13.727747 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:13.727786 (+ 39us) server_negotiation.cc:407] Connection header received
0809 02:19:13.727870 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:13.727871 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:13.727883 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:13.727932 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:13.728502 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:13.728987 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:13.729684 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:13.729874 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:13.729922 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:13.732379 (+ 2457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:13.732380 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:13.732380 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:13.732386 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:13.733713 (+ 1327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:13.734020 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:13.734021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:13.734021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:13.734071 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:13.734232 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:13.734233 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:13.734233 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:13.734319 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:13.734417 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:13.734489 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 02:19:13.734548 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 02:19:13.735215 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 11757
I20260809 02:19:13.741211 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 11900
I20260809 02:19:13.746837 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 12037
I20260809 02:19:13.753348 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 11659
2026-08-09T02:19:13Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (1999 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:19:13 dist-test-slave-w206 krb5kdc[12192](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:19:13 dist-test-slave-w206 krb5kdc[12192](info): set up 2 sockets
Aug 09 02:19:13 dist-test-slave-w206 krb5kdc[12192](info): commencing operation
krb5kdc: starting...
W20260809 02:19:14.832300 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.057s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:19:14 dist-test-slave-w206 krb5kdc[12192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241954, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:19:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:19:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:19:14.957645 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:42867
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:36633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:42867
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:15.039335 12208 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:15.039547 12208 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:15.039570 12208 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:15.040771 12208 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:19:15.040843 12208 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:15.040869 12208 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:15.040892 12208 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:19:15.040926 12208 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:19:15.042780 12208 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:36633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:42867
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:42867
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12208
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:15.043107 12208 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:15.043354 12208 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:15.048159 12217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:15.048177 12214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:15.048161 12215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:15.048677 12208 server_base.cc:1034] running on GCE node
I20260809 02:19:15.048965 12208 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:15.049247 12208 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:15.050416 12208 hybrid_clock.cc:648] HybridClock initialized: now 1786241955050403 us; error 44 us; skew 500 ppm
Aug 09 02:19:15 dist-test-slave-w206 krb5kdc[12192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241955, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:15.053028 12208 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:19:15.053493 12208 webserver.cc:460] Webserver started at http://127.11.93.190:40073/ using document root <none> and password file <none>
I20260809 02:19:15.053702 12208 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:15.053745 12208 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:15.053834 12208 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:15.054821 12208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "c45e18c29747481cbd1da17ef8b605b5"
format_stamp: "Formatted at 2026-08-09 02:19:15 on dist-test-slave-w206"
server_key: "99406048ba18956b1418ba41b06abd76"
server_key_iv: "d52926f78f8863573ebc3f161f3b492a"
server_key_version: "encryptionkey@0"
I20260809 02:19:15.055192 12208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "c45e18c29747481cbd1da17ef8b605b5"
format_stamp: "Formatted at 2026-08-09 02:19:15 on dist-test-slave-w206"
server_key: "99406048ba18956b1418ba41b06abd76"
server_key_iv: "d52926f78f8863573ebc3f161f3b492a"
server_key_version: "encryptionkey@0"
I20260809 02:19:15.056496 12208 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:15.057300 12224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:15.057499 12208 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:15.057591 12208 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "c45e18c29747481cbd1da17ef8b605b5"
format_stamp: "Formatted at 2026-08-09 02:19:15 on dist-test-slave-w206"
server_key: "99406048ba18956b1418ba41b06abd76"
server_key_iv: "d52926f78f8863573ebc3f161f3b492a"
server_key_version: "encryptionkey@0"
I20260809 02:19:15.057648 12208 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:15.070626 12208 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:15.073061 12208 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:15.073189 12208 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:15.077376 12208 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:42867
I20260809 02:19:15.077448 12278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:42867 every 8 connection(s)
I20260809 02:19:15.077804 12208 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:19:15.078749 12279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:15.081099 12279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c45e18c29747481cbd1da17ef8b605b5: Bootstrap starting.
I20260809 02:19:15.081678 12279 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c45e18c29747481cbd1da17ef8b605b5: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:15.081969 12279 log.cc:824] T 00000000000000000000000000000000 P c45e18c29747481cbd1da17ef8b605b5: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:15.082597 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 12208
I20260809 02:19:15.082684 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:19:15.082836 11638 external_mini_cluster.cc:1428] Setting key b36a4a629032bf413e32906b9a40975c
I20260809 02:19:15.082834 12279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c45e18c29747481cbd1da17ef8b605b5: No bootstrap required, opened a new log
I20260809 02:19:15.084612 12279 raft_consensus.cc:348] T 00000000000000000000000000000000 P c45e18c29747481cbd1da17ef8b605b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c45e18c29747481cbd1da17ef8b605b5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42867 } }
I20260809 02:19:15.084765 12279 raft_consensus.cc:374] T 00000000000000000000000000000000 P c45e18c29747481cbd1da17ef8b605b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:15.084787 12279 raft_consensus.cc:729] T 00000000000000000000000000000000 P c45e18c29747481cbd1da17ef8b605b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c45e18c29747481cbd1da17ef8b605b5, State: Initialized, Role: FOLLOWER
I20260809 02:19:15.084960 12279 consensus_queue.cc:260] T 00000000000000000000000000000000 P c45e18c29747481cbd1da17ef8b605b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c45e18c29747481cbd1da17ef8b605b5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42867 } }
I20260809 02:19:15.085024 12279 raft_consensus.cc:388] T 00000000000000000000000000000000 P c45e18c29747481cbd1da17ef8b605b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:19:15.085045 12279 raft_consensus.cc:482] T 00000000000000000000000000000000 P c45e18c29747481cbd1da17ef8b605b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:19:15.085107 12279 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c45e18c29747481cbd1da17ef8b605b5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:15.086064 12279 raft_consensus.cc:504] T 00000000000000000000000000000000 P c45e18c29747481cbd1da17ef8b605b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c45e18c29747481cbd1da17ef8b605b5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42867 } }
I20260809 02:19:15.086187 12279 leader_election.cc:302] T 00000000000000000000000000000000 P c45e18c29747481cbd1da17ef8b605b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c45e18c29747481cbd1da17ef8b605b5; no voters:
I20260809 02:19:15.086361 12279 leader_election.cc:288] T 00000000000000000000000000000000 P c45e18c29747481cbd1da17ef8b605b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:19:15.086414 12284 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c45e18c29747481cbd1da17ef8b605b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:15.086562 12284 raft_consensus.cc:686] T 00000000000000000000000000000000 P c45e18c29747481cbd1da17ef8b605b5 [term 1 LEADER]: Becoming Leader. State: Replica: c45e18c29747481cbd1da17ef8b605b5, State: Running, Role: LEADER
I20260809 02:19:15.086621 12279 sys_catalog.cc:564] T 00000000000000000000000000000000 P c45e18c29747481cbd1da17ef8b605b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:19:15.086650 12284 consensus_queue.cc:237] T 00000000000000000000000000000000 P c45e18c29747481cbd1da17ef8b605b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c45e18c29747481cbd1da17ef8b605b5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42867 } }
I20260809 02:19:15.087011 12286 sys_catalog.cc:455] T 00000000000000000000000000000000 P c45e18c29747481cbd1da17ef8b605b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c45e18c29747481cbd1da17ef8b605b5. Latest consensus state: current_term: 1 leader_uuid: "c45e18c29747481cbd1da17ef8b605b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c45e18c29747481cbd1da17ef8b605b5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42867 } } }
I20260809 02:19:15.087116 12286 sys_catalog.cc:458] T 00000000000000000000000000000000 P c45e18c29747481cbd1da17ef8b605b5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:15.088049 12292 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:19:15.087901 12285 sys_catalog.cc:455] T 00000000000000000000000000000000 P c45e18c29747481cbd1da17ef8b605b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c45e18c29747481cbd1da17ef8b605b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c45e18c29747481cbd1da17ef8b605b5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42867 } } }
I20260809 02:19:15.088879 12285 sys_catalog.cc:458] T 00000000000000000000000000000000 P c45e18c29747481cbd1da17ef8b605b5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:15.089329 12292 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:19:15.090760 12292 catalog_manager.cc:1347] Generated new cluster ID: d33a47e2f8ec4f27b86fd9f2217a8638
I20260809 02:19:15.090818 12292 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 02:19:15 dist-test-slave-w206 krb5kdc[12192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241954, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:15.095402 12283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:15.083447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58180 (local address 127.11.93.190:42867)
0809 02:19:15.083649 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:15.083663 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:15.083695 (+ 32us) server_negotiation.cc:407] Connection header received
0809 02:19:15.084602 (+ 907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:15.084609 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:15.084662 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:15.084817 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:15.085613 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.086786 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.087971 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.088540 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.088640 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:15.091514 (+ 2874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:15.091517 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:15.091518 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:15.091529 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:15.093527 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:15.093942 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:15.093944 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:15.093945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:15.094077 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:15.094310 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:15.094311 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:15.094311 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:15.094608 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:15.094772 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:15.094878 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 02:19:15.095051 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":82,"threads_started":1}
I20260809 02:19:15.102739 12292 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:19:15.103513 12292 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:19:15.110576 12292 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c45e18c29747481cbd1da17ef8b605b5: Generated new TSK 0
I20260809 02:19:15.110764 12292 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.93.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
I20260809 02:19:15.140069 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:42867
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:36633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:15.223475 12306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:15.223716 12306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:15.223753 12306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:15.224908 12306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:15.224977 12306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:15.225023 12306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:19:15.226548 12306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:36633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:42867
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12306
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:15.226830 12306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:15.227082 12306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:15.232090 12311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:15.232090 12312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:15.232086 12314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:15.232417 12306 server_base.cc:1034] running on GCE node
I20260809 02:19:15.232761 12306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:15.232964 12306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:15.234107 12306 hybrid_clock.cc:648] HybridClock initialized: now 1786241955234078 us; error 43 us; skew 500 ppm
Aug 09 02:19:15 dist-test-slave-w206 krb5kdc[12192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241955, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:15.236727 12306 init.cc:377] Logged in from keytab as kudu/127.11.93.129@KRBTEST.COM (short username kudu)
I20260809 02:19:15.237166 12306 webserver.cc:460] Webserver started at http://127.11.93.129:42825/ using document root <none> and password file <none>
I20260809 02:19:15.237423 12306 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:15.237495 12306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:15.237648 12306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:15.238749 12306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "8d580f3388c3456589c4c882d5392bd9"
format_stamp: "Formatted at 2026-08-09 02:19:15 on dist-test-slave-w206"
server_key: "62c95dd14aad75287f83f954c9916622"
server_key_iv: "4ce861e1327ef94a1d3934efc3f800b5"
server_key_version: "encryptionkey@0"
I20260809 02:19:15.239152 12306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "8d580f3388c3456589c4c882d5392bd9"
format_stamp: "Formatted at 2026-08-09 02:19:15 on dist-test-slave-w206"
server_key: "62c95dd14aad75287f83f954c9916622"
server_key_iv: "4ce861e1327ef94a1d3934efc3f800b5"
server_key_version: "encryptionkey@0"
I20260809 02:19:15.240576 12306 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:19:15.241401 12321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:15.241605 12306 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:19:15.241714 12306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "8d580f3388c3456589c4c882d5392bd9"
format_stamp: "Formatted at 2026-08-09 02:19:15 on dist-test-slave-w206"
server_key: "62c95dd14aad75287f83f954c9916622"
server_key_iv: "4ce861e1327ef94a1d3934efc3f800b5"
server_key_version: "encryptionkey@0"
I20260809 02:19:15.241797 12306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:15.253121 12306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:15.255307 12306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:15.255478 12306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:15.255712 12306 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:15.256031 12306 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:15.256086 12306 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:15.256127 12306 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:15.256155 12306 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:15.262327 12306 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:42143
I20260809 02:19:15.262418 12442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:42143 every 8 connection(s)
I20260809 02:19:15.262759 12306 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:19:15.265812 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 12306
I20260809 02:19:15.265910 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:19:15.266114 11638 external_mini_cluster.cc:1428] Setting key 48e377fb60875f0255a9d37ee3bb4c08
Aug 09 02:19:15 dist-test-slave-w206 krb5kdc[12192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241955, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:15.273787 12283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:15.263682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:56367 (local address 127.11.93.190:42867)
0809 02:19:15.263755 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:15.263757 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:15.263993 (+ 236us) server_negotiation.cc:407] Connection header received
0809 02:19:15.264994 (+ 1001us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:15.264995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:15.265011 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:15.265060 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:15.265711 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.266362 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.267454 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.267682 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.267771 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:15.270614 (+ 2843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:15.270615 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:15.270616 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:15.270624 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:15.272161 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:15.272745 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:15.272745 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:15.272746 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:15.272800 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:15.273113 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:15.273113 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:15.273114 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:15.273218 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:15.273270 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:15.273648 (+ 378us) server_negotiation.cc:299] Negotiation successful
0809 02:19:15.273721 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:19:15.274139 12445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:15.263640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42867 (local address 127.11.93.129:56367)
0809 02:19:15.263855 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:15.263892 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:15.264858 (+ 966us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:15.265147 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:15.265151 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:15.265424 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:15.265611 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:15.265615 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.266460 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.266461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:15.267363 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:15.267366 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.267783 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.267784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:15.267913 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:15.268481 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:15.268493 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:15.270516 (+ 2023us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:15.272254 (+ 1738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:15.272262 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:15.272264 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:15.272637 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:15.272874 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:15.272875 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:15.272876 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:15.273039 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:15.273291 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:15.273299 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:15.273493 (+ 194us) client_negotiation.cc:769] Sending connection context
0809 02:19:15.273636 (+ 143us) client_negotiation.cc:240] Negotiation successful
0809 02:19:15.273865 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":98,"threads_started":1}
I20260809 02:19:15.274747 12443 heartbeater.cc:347] Connected to a master server at 127.11.93.190:42867
I20260809 02:19:15.274844 12443 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:15.275072 12443 heartbeater.cc:511] Master 127.11.93.190:42867 requested a full tablet report, sending...
I20260809 02:19:15.275616 12242 ts_manager.cc:194] Registered new tserver with Master: 8d580f3388c3456589c4c882d5392bd9 (127.11.93.129:42143)
I20260809 02:19:15.276248 12242 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:56367
WARNING: no policy specified for kudu/127.11.93.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
I20260809 02:19:15.295485 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:42867
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:36633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:15.377928 12448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:15.378131 12448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:15.378155 12448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:15.379366 12448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:15.379410 12448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:15.379437 12448 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:19:15.381246 12448 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:36633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:42867
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:15.381498 12448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:15.381803 12448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:15.387156 12455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:15.387192 12457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:15.387173 12453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:15.387795 12448 server_base.cc:1034] running on GCE node
I20260809 02:19:15.388046 12448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:15.388302 12448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:15.389464 12448 hybrid_clock.cc:648] HybridClock initialized: now 1786241955389460 us; error 38 us; skew 500 ppm
Aug 09 02:19:15 dist-test-slave-w206 krb5kdc[12192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241955, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:15.392112 12448 init.cc:377] Logged in from keytab as kudu/127.11.93.130@KRBTEST.COM (short username kudu)
I20260809 02:19:15.392556 12448 webserver.cc:460] Webserver started at http://127.11.93.130:42199/ using document root <none> and password file <none>
I20260809 02:19:15.392808 12448 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:15.392879 12448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:15.393029 12448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:15.394095 12448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "fbb5c7e237b541af8e201587b5fdcb39"
format_stamp: "Formatted at 2026-08-09 02:19:15 on dist-test-slave-w206"
server_key: "b4d74c163e2257444b90743791f04196"
server_key_iv: "1c18b05d336ebfccc6723c672a0831c5"
server_key_version: "encryptionkey@0"
I20260809 02:19:15.394464 12448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "fbb5c7e237b541af8e201587b5fdcb39"
format_stamp: "Formatted at 2026-08-09 02:19:15 on dist-test-slave-w206"
server_key: "b4d74c163e2257444b90743791f04196"
server_key_iv: "1c18b05d336ebfccc6723c672a0831c5"
server_key_version: "encryptionkey@0"
I20260809 02:19:15.395922 12448 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:19:15.396749 12464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:15.396947 12448 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:15.397056 12448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "fbb5c7e237b541af8e201587b5fdcb39"
format_stamp: "Formatted at 2026-08-09 02:19:15 on dist-test-slave-w206"
server_key: "b4d74c163e2257444b90743791f04196"
server_key_iv: "1c18b05d336ebfccc6723c672a0831c5"
server_key_version: "encryptionkey@0"
I20260809 02:19:15.397130 12448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:15.419090 12448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:15.421128 12448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:15.421301 12448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:15.421558 12448 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:15.421873 12448 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:15.421932 12448 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:15.421968 12448 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:15.422017 12448 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:15.427997 12448 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:40851
I20260809 02:19:15.428043 12590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:40851 every 8 connection(s)
I20260809 02:19:15.428417 12448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:19:15.431138 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 12448
I20260809 02:19:15.431228 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:19:15.431406 11638 external_mini_cluster.cc:1428] Setting key 9efd663c14087d6e61ba5e1dbbda6bbc
Aug 09 02:19:15 dist-test-slave-w206 krb5kdc[12192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241955, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:15.438620 12283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:15.429192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:57689 (local address 127.11.93.190:42867)
0809 02:19:15.429274 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:15.429277 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:15.429506 (+ 229us) server_negotiation.cc:407] Connection header received
0809 02:19:15.430467 (+ 961us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:15.430469 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:15.430481 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:15.430543 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:15.431358 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.432035 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.433081 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.433407 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.433489 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:15.435756 (+ 2267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:15.435757 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:15.435758 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:15.435765 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:15.437155 (+ 1390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:15.437586 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:15.437588 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:15.437589 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:15.437655 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:15.437935 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:15.437936 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:15.437937 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:15.438059 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:15.438140 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:15.438427 (+ 287us) server_negotiation.cc:299] Negotiation successful
0809 02:19:15.438522 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:19:15.438891 12594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:15.429159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42867 (local address 127.11.93.130:57689)
0809 02:19:15.429358 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:15.429395 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:15.430348 (+ 953us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:15.430619 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:15.430622 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:15.430891 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:15.431245 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:15.431252 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.432134 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.432135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:15.432975 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:15.432978 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.433501 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.433502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:15.433605 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:15.434196 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:15.434204 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:15.435642 (+ 1438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:15.437245 (+ 1603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:15.437252 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:15.437254 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:15.437490 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:15.437725 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:15.437726 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:15.437727 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:15.437846 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:15.438130 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:15.438136 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:15.438282 (+ 146us) client_negotiation.cc:769] Sending connection context
0809 02:19:15.438396 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 02:19:15.438561 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":103,"threads_started":1}
I20260809 02:19:15.439474 12592 heartbeater.cc:347] Connected to a master server at 127.11.93.190:42867
I20260809 02:19:15.439564 12592 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:15.439764 12592 heartbeater.cc:511] Master 127.11.93.190:42867 requested a full tablet report, sending...
I20260809 02:19:15.440325 12242 ts_manager.cc:194] Registered new tserver with Master: fbb5c7e237b541af8e201587b5fdcb39 (127.11.93.130:40851)
I20260809 02:19:15.440703 12242 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:57689
WARNING: no policy specified for kudu/127.11.93.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
I20260809 02:19:15.459899 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:42867
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:36633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:15.544104 12597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:15.544312 12597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:15.544337 12597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:15.545519 12597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:15.545559 12597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:15.545586 12597 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:19:15.547039 12597 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:36633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:42867
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12597
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:15.547231 12597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:15.547407 12597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:15.552508 12603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:15.552503 12604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:15.552515 12606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:15.553035 12597 server_base.cc:1034] running on GCE node
I20260809 02:19:15.553211 12597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:15.553429 12597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:15.554582 12597 hybrid_clock.cc:648] HybridClock initialized: now 1786241955554568 us; error 47 us; skew 500 ppm
Aug 09 02:19:15 dist-test-slave-w206 krb5kdc[12192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241955, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:15.557142 12597 init.cc:377] Logged in from keytab as kudu/127.11.93.131@KRBTEST.COM (short username kudu)
I20260809 02:19:15.557595 12597 webserver.cc:460] Webserver started at http://127.11.93.131:40959/ using document root <none> and password file <none>
I20260809 02:19:15.557821 12597 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:15.557888 12597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:15.558051 12597 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:15.559162 12597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "fc145d1c154c40faa579e241c4bd5944"
format_stamp: "Formatted at 2026-08-09 02:19:15 on dist-test-slave-w206"
server_key: "d80d6b43750d61856370bf0f484b1460"
server_key_iv: "1c2030b9a3f1f4b8c311a987c87ad9f0"
server_key_version: "encryptionkey@0"
I20260809 02:19:15.559520 12597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "fc145d1c154c40faa579e241c4bd5944"
format_stamp: "Formatted at 2026-08-09 02:19:15 on dist-test-slave-w206"
server_key: "d80d6b43750d61856370bf0f484b1460"
server_key_iv: "1c2030b9a3f1f4b8c311a987c87ad9f0"
server_key_version: "encryptionkey@0"
I20260809 02:19:15.561028 12597 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 02:19:15.561872 12613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:15.562065 12597 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:15.562163 12597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "fc145d1c154c40faa579e241c4bd5944"
format_stamp: "Formatted at 2026-08-09 02:19:15 on dist-test-slave-w206"
server_key: "d80d6b43750d61856370bf0f484b1460"
server_key_iv: "1c2030b9a3f1f4b8c311a987c87ad9f0"
server_key_version: "encryptionkey@0"
I20260809 02:19:15.562250 12597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:15.593339 12597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:15.596062 12597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:15.596244 12597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:15.596489 12597 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:15.596822 12597 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:15.596877 12597 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:15.596930 12597 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:15.596957 12597 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:15.603150 12597 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:45213
I20260809 02:19:15.603205 12735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:45213 every 8 connection(s)
I20260809 02:19:15.603519 12597 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:19:15.605940 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 12597
I20260809 02:19:15.606036 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:19:15.606207 11638 external_mini_cluster.cc:1428] Setting key f22741695f274baf495a952562613e4a
Aug 09 02:19:15 dist-test-slave-w206 krb5kdc[12192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241955, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:15.613305 12283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:15.604331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:45991 (local address 127.11.93.190:42867)
0809 02:19:15.604399 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:15.604401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:15.604648 (+ 247us) server_negotiation.cc:407] Connection header received
0809 02:19:15.605699 (+ 1051us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:15.605700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:15.605711 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:15.605795 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:15.606736 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.607390 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.608361 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.608541 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.608590 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:15.610721 (+ 2131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:15.610723 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:15.610727 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:15.610735 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:15.612010 (+ 1275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:15.612403 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:15.612403 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:15.612404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:15.612456 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:15.612759 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:15.612760 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:15.612760 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:15.612859 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:15.612911 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:15.613178 (+ 267us) server_negotiation.cc:299] Negotiation successful
0809 02:19:15.613240 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 02:19:15.613500 12738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:15.604276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42867 (local address 127.11.93.131:45991)
0809 02:19:15.604478 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:15.604534 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:15.605596 (+ 1062us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:15.605941 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:15.605946 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:15.606330 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:15.606638 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:15.606644 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.607478 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.607479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:15.608289 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:15.608291 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.608614 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.608615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:15.608717 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:15.609156 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:15.609165 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:15.610636 (+ 1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:15.612083 (+ 1447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:15.612089 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:15.612090 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:15.612324 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:15.612548 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:15.612549 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:15.612549 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:15.612689 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:15.612940 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:15.612947 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:15.613062 (+ 115us) client_negotiation.cc:769] Sending connection context
0809 02:19:15.613152 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 02:19:15.613287 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":91,"threads_started":1}
I20260809 02:19:15.614051 12736 heartbeater.cc:347] Connected to a master server at 127.11.93.190:42867
I20260809 02:19:15.614140 12736 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:15.614276 12736 heartbeater.cc:511] Master 127.11.93.190:42867 requested a full tablet report, sending...
I20260809 02:19:15.614624 12242 ts_manager.cc:194] Registered new tserver with Master: fc145d1c154c40faa579e241c4bd5944 (127.11.93.131:45213)
I20260809 02:19:15.615058 12242 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:45991
I20260809 02:19:15.617888 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:19:15.625921 12283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:15.619779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58182 (local address 127.11.93.190:42867)
0809 02:19:15.619845 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:15.619847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:15.619993 (+ 146us) server_negotiation.cc:407] Connection header received
0809 02:19:15.620043 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:15.620043 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:15.620052 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:15.620099 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:15.620643 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.621114 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.621879 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.622062 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.622115 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:15.623446 (+ 1331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:15.623447 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:15.623447 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:15.623452 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:15.624749 (+ 1297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:15.625061 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:15.625061 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:15.625062 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:15.625113 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:15.625389 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:15.625389 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:15.625389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:15.625525 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:15.625598 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:15.625768 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 02:19:15.625830 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 02:19:15.628834 12242 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58182:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:19:15.630700 12242 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:19:15.638278 12752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:15.634094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33266 (local address 127.11.93.129:42143)
0809 02:19:15.634291 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:15.634295 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:15.634711 (+ 416us) server_negotiation.cc:407] Connection header received
0809 02:19:15.634765 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:15.634767 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:15.634782 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:15.634869 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:15.635128 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.636156 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.637135 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.637858 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.637936 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:15.637995 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:15.638153 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 02:19:15.638190 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":99,"threads_started":1}
I20260809 02:19:15.638269 12748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:15.633824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:42143 (local address 127.0.0.1:33266)
0809 02:19:15.634602 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:15.634612 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:15.634667 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:15.635001 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:15.635002 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:15.635004 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:15.635047 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:15.635049 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.636254 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.636255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:15.637022 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:15.637024 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.637949 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.637950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:15.638045 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:15.638056 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 02:19:15.638138 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 02:19:15.638199 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":758,"mutex_wait_us":20,"thread_start_us":101,"threads_started":1}
I20260809 02:19:15.638650 12747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:15.633776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:45213 (local address 127.0.0.1:47908)
0809 02:19:15.633944 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:15.633986 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:15.634056 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:15.634515 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:15.634519 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:15.634521 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:15.634594 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:15.634596 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.636050 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.636051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:15.637385 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:15.637389 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.638387 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.638388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:15.638475 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:15.638479 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:19:15.638528 (+ 49us) client_negotiation.cc:240] Negotiation successful
0809 02:19:15.638575 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":49,"threads_started":1}
I20260809 02:19:15.638810 12749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:15.633824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:40851 (local address 127.0.0.1:59856)
0809 02:19:15.634742 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:15.634750 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:15.634807 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:15.635083 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:15.635084 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:15.635086 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:15.635140 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:15.635142 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.636305 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.636306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:15.637411 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:15.637413 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.638579 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.638580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:15.638632 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:15.638635 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:19:15.638684 (+ 49us) client_negotiation.cc:240] Negotiation successful
0809 02:19:15.638726 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":897,"mutex_wait_us":2,"thread_start_us":93,"threads_started":1}
I20260809 02:19:15.639002 12750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:15.633863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47908 (local address 127.11.93.131:45213)
0809 02:19:15.634326 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:15.634329 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:15.634339 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:19:15.634384 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:15.634386 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:15.634406 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:15.634493 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:15.634707 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.635941 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.637569 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.638239 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.638299 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:15.638349 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:15.638828 (+ 479us) server_negotiation.cc:299] Negotiation successful
0809 02:19:15.638881 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":104,"threads_started":1}
I20260809 02:19:15.639178 12751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:15.634090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59856 (local address 127.11.93.130:40851)
0809 02:19:15.634256 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:15.634261 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:15.634813 (+ 552us) server_negotiation.cc:407] Connection header received
0809 02:19:15.634870 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:15.634872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:15.634887 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:15.634991 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:15.635223 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.636189 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.637506 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.638226 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.638299 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:15.638349 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:15.639004 (+ 655us) server_negotiation.cc:299] Negotiation successful
0809 02:19:15.639057 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":88,"threads_started":1}
I20260809 02:19:15.639267 12374 tablet_service.cc:1467] Processing CreateTablet for tablet 7cdcdfdec5f3427399fabce44036b3c4 (DEFAULT_TABLE table=test-table [id=e41624f0965044a4ae88b05e536ce1c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:15.639643 12374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cdcdfdec5f3427399fabce44036b3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:15.639621 12664 tablet_service.cc:1467] Processing CreateTablet for tablet 7cdcdfdec5f3427399fabce44036b3c4 (DEFAULT_TABLE table=test-table [id=e41624f0965044a4ae88b05e536ce1c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:15.639811 12516 tablet_service.cc:1467] Processing CreateTablet for tablet 7cdcdfdec5f3427399fabce44036b3c4 (DEFAULT_TABLE table=test-table [id=e41624f0965044a4ae88b05e536ce1c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:15.639953 12664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cdcdfdec5f3427399fabce44036b3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:15.640144 12516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cdcdfdec5f3427399fabce44036b3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:15.642609 12753 tablet_bootstrap.cc:492] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944: Bootstrap starting.
I20260809 02:19:15.643138 12754 tablet_bootstrap.cc:492] T 7cdcdfdec5f3427399fabce44036b3c4 P 8d580f3388c3456589c4c882d5392bd9: Bootstrap starting.
I20260809 02:19:15.643533 12753 tablet_bootstrap.cc:654] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:15.643554 12755 tablet_bootstrap.cc:492] T 7cdcdfdec5f3427399fabce44036b3c4 P fbb5c7e237b541af8e201587b5fdcb39: Bootstrap starting.
I20260809 02:19:15.643927 12754 tablet_bootstrap.cc:654] T 7cdcdfdec5f3427399fabce44036b3c4 P 8d580f3388c3456589c4c882d5392bd9: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:15.644191 12755 tablet_bootstrap.cc:654] T 7cdcdfdec5f3427399fabce44036b3c4 P fbb5c7e237b541af8e201587b5fdcb39: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:15.644580 12753 log.cc:824] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:15.644681 12754 log.cc:824] T 7cdcdfdec5f3427399fabce44036b3c4 P 8d580f3388c3456589c4c882d5392bd9: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:15.644745 12755 log.cc:824] T 7cdcdfdec5f3427399fabce44036b3c4 P fbb5c7e237b541af8e201587b5fdcb39: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:15.645442 12753 tablet_bootstrap.cc:492] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944: No bootstrap required, opened a new log
I20260809 02:19:15.645525 12753 ts_tablet_manager.cc:1397] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260809 02:19:15.645558 12755 tablet_bootstrap.cc:492] T 7cdcdfdec5f3427399fabce44036b3c4 P fbb5c7e237b541af8e201587b5fdcb39: No bootstrap required, opened a new log
I20260809 02:19:15.645627 12755 ts_tablet_manager.cc:1397] T 7cdcdfdec5f3427399fabce44036b3c4 P fbb5c7e237b541af8e201587b5fdcb39: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:19:15.647166 12755 raft_consensus.cc:348] T 7cdcdfdec5f3427399fabce44036b3c4 P fbb5c7e237b541af8e201587b5fdcb39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc145d1c154c40faa579e241c4bd5944" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 45213 } } peers { permanent_uuid: "fbb5c7e237b541af8e201587b5fdcb39" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40851 } } peers { permanent_uuid: "8d580f3388c3456589c4c882d5392bd9" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 42143 } }
I20260809 02:19:15.647197 12753 raft_consensus.cc:348] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc145d1c154c40faa579e241c4bd5944" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 45213 } } peers { permanent_uuid: "fbb5c7e237b541af8e201587b5fdcb39" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40851 } } peers { permanent_uuid: "8d580f3388c3456589c4c882d5392bd9" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 42143 } }
I20260809 02:19:15.647329 12755 raft_consensus.cc:374] T 7cdcdfdec5f3427399fabce44036b3c4 P fbb5c7e237b541af8e201587b5fdcb39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:15.647370 12755 raft_consensus.cc:729] T 7cdcdfdec5f3427399fabce44036b3c4 P fbb5c7e237b541af8e201587b5fdcb39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbb5c7e237b541af8e201587b5fdcb39, State: Initialized, Role: FOLLOWER
I20260809 02:19:15.647368 12753 raft_consensus.cc:374] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:15.647367 12754 tablet_bootstrap.cc:492] T 7cdcdfdec5f3427399fabce44036b3c4 P 8d580f3388c3456589c4c882d5392bd9: No bootstrap required, opened a new log
I20260809 02:19:15.647408 12753 raft_consensus.cc:729] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc145d1c154c40faa579e241c4bd5944, State: Initialized, Role: FOLLOWER
I20260809 02:19:15.647451 12754 ts_tablet_manager.cc:1397] T 7cdcdfdec5f3427399fabce44036b3c4 P 8d580f3388c3456589c4c882d5392bd9: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260809 02:19:15.647481 12755 consensus_queue.cc:260] T 7cdcdfdec5f3427399fabce44036b3c4 P fbb5c7e237b541af8e201587b5fdcb39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc145d1c154c40faa579e241c4bd5944" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 45213 } } peers { permanent_uuid: "fbb5c7e237b541af8e201587b5fdcb39" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40851 } } peers { permanent_uuid: "8d580f3388c3456589c4c882d5392bd9" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 42143 } }
I20260809 02:19:15.647526 12753 consensus_queue.cc:260] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc145d1c154c40faa579e241c4bd5944" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 45213 } } peers { permanent_uuid: "fbb5c7e237b541af8e201587b5fdcb39" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40851 } } peers { permanent_uuid: "8d580f3388c3456589c4c882d5392bd9" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 42143 } }
I20260809 02:19:15.647789 12753 ts_tablet_manager.cc:1428] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:19:15.647802 12755 ts_tablet_manager.cc:1428] T 7cdcdfdec5f3427399fabce44036b3c4 P fbb5c7e237b541af8e201587b5fdcb39: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:19:15.647832 12592 heartbeater.cc:503] Master 127.11.93.190:42867 was elected leader, sending a full tablet report...
I20260809 02:19:15.647945 12736 heartbeater.cc:503] Master 127.11.93.190:42867 was elected leader, sending a full tablet report...
I20260809 02:19:15.649091 12754 raft_consensus.cc:348] T 7cdcdfdec5f3427399fabce44036b3c4 P 8d580f3388c3456589c4c882d5392bd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc145d1c154c40faa579e241c4bd5944" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 45213 } } peers { permanent_uuid: "fbb5c7e237b541af8e201587b5fdcb39" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40851 } } peers { permanent_uuid: "8d580f3388c3456589c4c882d5392bd9" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 42143 } }
I20260809 02:19:15.649216 12754 raft_consensus.cc:374] T 7cdcdfdec5f3427399fabce44036b3c4 P 8d580f3388c3456589c4c882d5392bd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:15.649237 12754 raft_consensus.cc:729] T 7cdcdfdec5f3427399fabce44036b3c4 P 8d580f3388c3456589c4c882d5392bd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d580f3388c3456589c4c882d5392bd9, State: Initialized, Role: FOLLOWER
I20260809 02:19:15.649309 12754 consensus_queue.cc:260] T 7cdcdfdec5f3427399fabce44036b3c4 P 8d580f3388c3456589c4c882d5392bd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc145d1c154c40faa579e241c4bd5944" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 45213 } } peers { permanent_uuid: "fbb5c7e237b541af8e201587b5fdcb39" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40851 } } peers { permanent_uuid: "8d580f3388c3456589c4c882d5392bd9" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 42143 } }
I20260809 02:19:15.649508 12754 ts_tablet_manager.cc:1428] T 7cdcdfdec5f3427399fabce44036b3c4 P 8d580f3388c3456589c4c882d5392bd9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:19:15.649554 12443 heartbeater.cc:503] Master 127.11.93.190:42867 was elected leader, sending a full tablet report...
W20260809 02:19:15.679013 12593 tablet.cc:2369] T 7cdcdfdec5f3427399fabce44036b3c4 P fbb5c7e237b541af8e201587b5fdcb39: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:19:15.690078 12760 raft_consensus.cc:482] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:19:15.690225 12760 raft_consensus.cc:504] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc145d1c154c40faa579e241c4bd5944" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 45213 } } peers { permanent_uuid: "fbb5c7e237b541af8e201587b5fdcb39" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40851 } } peers { permanent_uuid: "8d580f3388c3456589c4c882d5392bd9" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 42143 } }
I20260809 02:19:15.690783 12760 leader_election.cc:288] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbb5c7e237b541af8e201587b5fdcb39 (127.11.93.130:40851), 8d580f3388c3456589c4c882d5392bd9 (127.11.93.129:42143)
I20260809 02:19:15.693789 12752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:15.691088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:36643 (local address 127.11.93.129:42143)
0809 02:19:15.691132 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:15.691134 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:15.691175 (+ 41us) server_negotiation.cc:407] Connection header received
0809 02:19:15.691206 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:15.691207 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:15.691220 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:15.691276 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:15.691469 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.692051 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.693036 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.693425 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.693480 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:15.693487 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:15.693674 (+ 187us) server_negotiation.cc:299] Negotiation successful
0809 02:19:15.693715 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 02:19:15.693813 12762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:15.691015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:40851 (local address 127.11.93.131:45215)
0809 02:19:15.691197 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:15.691208 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:15.691272 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:15.691417 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:15.691417 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:15.691419 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:15.691511 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:15.691513 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.692202 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.692203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:15.692955 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:15.692957 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.693554 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.693555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:15.693608 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:15.693611 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:19:15.693688 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 02:19:15.693729 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":114,"threads_started":1}
I20260809 02:19:15.693819 12751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:15.691066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:45215 (local address 127.11.93.130:40851)
0809 02:19:15.691123 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:15.691125 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:15.691288 (+ 163us) server_negotiation.cc:407] Connection header received
0809 02:19:15.691322 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:15.691323 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:15.691333 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:15.691398 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:15.691618 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.692078 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.693076 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.693447 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.693541 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:15.693549 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:15.693705 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 02:19:15.693746 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 02:19:15.693812 12738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:15.690992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:42143 (local address 127.11.93.131:36643)
0809 02:19:15.691059 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:15.691073 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:15.691125 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:15.691305 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:15.691306 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:15.691309 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:15.691389 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:15.691391 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.692157 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.692159 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:15.692943 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:15.692946 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.693509 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.693510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:15.693598 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:15.693601 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:19:15.693644 (+ 43us) client_negotiation.cc:240] Negotiation successful
0809 02:19:15.693707 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 02:19:15.694216 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cdcdfdec5f3427399fabce44036b3c4" candidate_uuid: "fc145d1c154c40faa579e241c4bd5944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbb5c7e237b541af8e201587b5fdcb39" is_pre_election: true
I20260809 02:19:15.694411 12538 raft_consensus.cc:2454] T 7cdcdfdec5f3427399fabce44036b3c4 P fbb5c7e237b541af8e201587b5fdcb39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc145d1c154c40faa579e241c4bd5944 in term 0.
I20260809 02:19:15.694430 12396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cdcdfdec5f3427399fabce44036b3c4" candidate_uuid: "fc145d1c154c40faa579e241c4bd5944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d580f3388c3456589c4c882d5392bd9" is_pre_election: true
I20260809 02:19:15.694602 12396 raft_consensus.cc:2454] T 7cdcdfdec5f3427399fabce44036b3c4 P 8d580f3388c3456589c4c882d5392bd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc145d1c154c40faa579e241c4bd5944 in term 0.
I20260809 02:19:15.694706 12616 leader_election.cc:302] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: fbb5c7e237b541af8e201587b5fdcb39, fc145d1c154c40faa579e241c4bd5944; no voters:
I20260809 02:19:15.694834 12760 raft_consensus.cc:2781] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:19:15.694906 12760 raft_consensus.cc:482] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:19:15.694936 12760 raft_consensus.cc:3037] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:15.695750 12760 raft_consensus.cc:504] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc145d1c154c40faa579e241c4bd5944" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 45213 } } peers { permanent_uuid: "fbb5c7e237b541af8e201587b5fdcb39" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40851 } } peers { permanent_uuid: "8d580f3388c3456589c4c882d5392bd9" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 42143 } }
I20260809 02:19:15.695892 12760 leader_election.cc:288] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944 [CANDIDATE]: Term 1 election: Requested vote from peers fbb5c7e237b541af8e201587b5fdcb39 (127.11.93.130:40851), 8d580f3388c3456589c4c882d5392bd9 (127.11.93.129:42143)
I20260809 02:19:15.696038 12396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cdcdfdec5f3427399fabce44036b3c4" candidate_uuid: "fc145d1c154c40faa579e241c4bd5944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d580f3388c3456589c4c882d5392bd9"
I20260809 02:19:15.696081 12538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cdcdfdec5f3427399fabce44036b3c4" candidate_uuid: "fc145d1c154c40faa579e241c4bd5944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbb5c7e237b541af8e201587b5fdcb39"
I20260809 02:19:15.696137 12396 raft_consensus.cc:3037] T 7cdcdfdec5f3427399fabce44036b3c4 P 8d580f3388c3456589c4c882d5392bd9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:15.696138 12538 raft_consensus.cc:3037] T 7cdcdfdec5f3427399fabce44036b3c4 P fbb5c7e237b541af8e201587b5fdcb39 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:15.696857 12538 raft_consensus.cc:2454] T 7cdcdfdec5f3427399fabce44036b3c4 P fbb5c7e237b541af8e201587b5fdcb39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc145d1c154c40faa579e241c4bd5944 in term 1.
I20260809 02:19:15.696879 12396 raft_consensus.cc:2454] T 7cdcdfdec5f3427399fabce44036b3c4 P 8d580f3388c3456589c4c882d5392bd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc145d1c154c40faa579e241c4bd5944 in term 1.
I20260809 02:19:15.697060 12617 leader_election.cc:302] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d580f3388c3456589c4c882d5392bd9, fc145d1c154c40faa579e241c4bd5944; no voters:
I20260809 02:19:15.697213 12760 raft_consensus.cc:2781] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:15.697356 12760 raft_consensus.cc:686] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944 [term 1 LEADER]: Becoming Leader. State: Replica: fc145d1c154c40faa579e241c4bd5944, State: Running, Role: LEADER
I20260809 02:19:15.697460 12760 consensus_queue.cc:237] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc145d1c154c40faa579e241c4bd5944" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 45213 } } peers { permanent_uuid: "fbb5c7e237b541af8e201587b5fdcb39" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40851 } } peers { permanent_uuid: "8d580f3388c3456589c4c882d5392bd9" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 42143 } }
I20260809 02:19:15.698352 12242 catalog_manager.cc:5495] T 7cdcdfdec5f3427399fabce44036b3c4 P fc145d1c154c40faa579e241c4bd5944 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc145d1c154c40faa579e241c4bd5944 (127.11.93.131). New cstate: current_term: 1 leader_uuid: "fc145d1c154c40faa579e241c4bd5944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc145d1c154c40faa579e241c4bd5944" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 45213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbb5c7e237b541af8e201587b5fdcb39" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d580f3388c3456589c4c882d5392bd9" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 42143 } health_report { overall_health: UNKNOWN } } }
Aug 09 02:19:15 dist-test-slave-w206 krb5kdc[12192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241954, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.129@KRBTEST.COM
I20260809 02:19:15.719077 12752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:15.711468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32846 (local address 127.11.93.129:42143)
0809 02:19:15.711544 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:15.711547 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:15.711640 (+ 93us) server_negotiation.cc:407] Connection header received
0809 02:19:15.711723 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:15.711724 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:15.711734 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:15.711822 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:15.712398 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.712893 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.713647 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.713854 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.713933 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:15.716411 (+ 2478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:15.716423 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:15.716423 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:15.716430 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:15.717862 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:15.718288 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:15.718291 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:15.718291 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:15.718351 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:15.718527 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:15.718527 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:15.718527 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:15.718667 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:15.718802 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:15.718882 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 02:19:15.718949 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
Aug 09 02:19:15 dist-test-slave-w206 krb5kdc[12192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241955, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 02:19:15 dist-test-slave-w206 krb5kdc[12192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241955, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.93.129@KRBTEST.COM
I20260809 02:19:15.742501 12752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:15.735783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32860 (local address 127.11.93.129:42143)
0809 02:19:15.735835 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:15.735837 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:15.735911 (+ 74us) server_negotiation.cc:407] Connection header received
0809 02:19:15.735968 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:15.735969 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:15.735978 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:15.736018 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:15.736565 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.737023 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.737734 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.737907 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.737955 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:15.740312 (+ 2357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:15.740313 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:15.740313 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:15.740319 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:15.741511 (+ 1192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:15.741845 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:15.741846 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:15.741846 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:15.741896 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:15.742061 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:15.742061 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:15.742061 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:15.742149 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:15.742218 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:15.742368 (+ 150us) server_negotiation.cc:299] Negotiation successful
0809 02:19:15.742437 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
Aug 09 02:19:15 dist-test-slave-w206 krb5kdc[12192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241955, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 02:19:15 dist-test-slave-w206 krb5kdc[12192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241955, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.129@KRBTEST.COM
W20260809 02:19:15.763634 12444 tablet.cc:2369] T 7cdcdfdec5f3427399fabce44036b3c4 P 8d580f3388c3456589c4c882d5392bd9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:19:15.765039 12752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:15.758047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32872 (local address 127.11.93.129:42143)
0809 02:19:15.758110 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:15.758112 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:15.758153 (+ 41us) server_negotiation.cc:407] Connection header received
0809 02:19:15.758212 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:15.758213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:15.758221 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:15.758310 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:15.758838 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.759398 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.760108 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:15.760313 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:15.760367 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:15.762568 (+ 2201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:15.762569 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:15.762569 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:15.762575 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:15.764032 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:15.764337 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:15.764337 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:15.764338 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:15.764387 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:15.764546 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:15.764547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:15.764547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:15.764631 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:15.764699 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:15.764843 (+ 144us) server_negotiation.cc:299] Negotiation successful
0809 02:19:15.764921 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260809 02:19:15.765710 12352 tablet_service.cc:2908] Rejecting scan request for tablet 7cdcdfdec5f3427399fabce44036b3c4: Uninitialized: clean time has not yet been initialized
I20260809 02:19:15.766693 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 12306
I20260809 02:19:15.775342 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 12448
I20260809 02:19:15.782375 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 12597
I20260809 02:19:15.788489 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 12208
2026-08-09T02:19:15Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2036 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:19:15 dist-test-slave-w206 krb5kdc[12778](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:19:15 dist-test-slave-w206 krb5kdc[12778](info): set up 2 sockets
Aug 09 02:19:15 dist-test-slave-w206 krb5kdc[12778](info): commencing operation
krb5kdc: starting...
W20260809 02:19:16.865341 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.054s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:19:16 dist-test-slave-w206 krb5kdc[12778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241956, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:19:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:19:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:19:16.986053 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:37369
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:42041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:37369
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:17.068331 12791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:17.068583 12791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:17.068622 12791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:17.069777 12791 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:19:17.069851 12791 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 02:19:17.069878 12791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:17.069918 12791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:17.069967 12791 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:19:17.069998 12791 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:19:17.071669 12791 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:42041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:37369
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:37369
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:17.071945 12791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:17.072186 12791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:17.077157 12797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:17.077169 12799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:17.077196 12796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:17.077374 12791 server_base.cc:1034] running on GCE node
I20260809 02:19:17.077695 12791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:17.078002 12791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:17.079144 12791 hybrid_clock.cc:648] HybridClock initialized: now 1786241957079116 us; error 42 us; skew 500 ppm
Aug 09 02:19:17 dist-test-slave-w206 krb5kdc[12778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241957, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:17.081604 12791 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:19:17.082039 12791 webserver.cc:460] Webserver started at http://127.11.93.190:37427/ using document root <none> and password file <none>
I20260809 02:19:17.082270 12791 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:17.082340 12791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:17.082510 12791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:17.083693 12791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "b7c8e1962d6a4b578e972f41ded60f1a"
format_stamp: "Formatted at 2026-08-09 02:19:17 on dist-test-slave-w206"
server_key: "52f0965a00a39f8262ea7fbfb19f92ff"
server_key_iv: "f7a7176ba0c73d32479dfafacb545c38"
server_key_version: "encryptionkey@0"
I20260809 02:19:17.084074 12791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "b7c8e1962d6a4b578e972f41ded60f1a"
format_stamp: "Formatted at 2026-08-09 02:19:17 on dist-test-slave-w206"
server_key: "52f0965a00a39f8262ea7fbfb19f92ff"
server_key_iv: "f7a7176ba0c73d32479dfafacb545c38"
server_key_version: "encryptionkey@0"
I20260809 02:19:17.085448 12791 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 02:19:17.086158 12807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:17.086333 12791 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:17.086436 12791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "b7c8e1962d6a4b578e972f41ded60f1a"
format_stamp: "Formatted at 2026-08-09 02:19:17 on dist-test-slave-w206"
server_key: "52f0965a00a39f8262ea7fbfb19f92ff"
server_key_iv: "f7a7176ba0c73d32479dfafacb545c38"
server_key_version: "encryptionkey@0"
I20260809 02:19:17.086517 12791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:17.101004 12791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:17.102902 12791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:17.103101 12791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:17.107824 12791 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:37369
I20260809 02:19:17.107921 12875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:37369 every 8 connection(s)
I20260809 02:19:17.108247 12791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:19:17.108899 12876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:17.111186 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 12791
I20260809 02:19:17.111271 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:19:17.111464 11638 external_mini_cluster.cc:1428] Setting key 78dabc702a89b5a848c055959bb5b8d5
I20260809 02:19:17.111476 12876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a: Bootstrap starting.
I20260809 02:19:17.112162 12876 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:17.112457 12876 log.cc:824] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:17.113210 12876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a: No bootstrap required, opened a new log
I20260809 02:19:17.114535 12876 raft_consensus.cc:348] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7c8e1962d6a4b578e972f41ded60f1a" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 37369 } }
I20260809 02:19:17.114696 12876 raft_consensus.cc:374] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:17.114742 12876 raft_consensus.cc:729] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7c8e1962d6a4b578e972f41ded60f1a, State: Initialized, Role: FOLLOWER
I20260809 02:19:17.114943 12876 consensus_queue.cc:260] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7c8e1962d6a4b578e972f41ded60f1a" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 37369 } }
I20260809 02:19:17.115090 12876 raft_consensus.cc:388] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:19:17.115137 12876 raft_consensus.cc:482] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:19:17.115206 12876 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:17.115737 12876 raft_consensus.cc:504] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7c8e1962d6a4b578e972f41ded60f1a" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 37369 } }
I20260809 02:19:17.115859 12876 leader_election.cc:302] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b7c8e1962d6a4b578e972f41ded60f1a; no voters:
I20260809 02:19:17.116096 12876 leader_election.cc:288] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:19:17.116127 12881 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:17.116247 12881 raft_consensus.cc:686] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a [term 1 LEADER]: Becoming Leader. State: Replica: b7c8e1962d6a4b578e972f41ded60f1a, State: Running, Role: LEADER
I20260809 02:19:17.116369 12876 sys_catalog.cc:564] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:19:17.116343 12881 consensus_queue.cc:237] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7c8e1962d6a4b578e972f41ded60f1a" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 37369 } }
I20260809 02:19:17.116703 12881 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader b7c8e1962d6a4b578e972f41ded60f1a. Latest consensus state: current_term: 1 leader_uuid: "b7c8e1962d6a4b578e972f41ded60f1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7c8e1962d6a4b578e972f41ded60f1a" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 37369 } } }
I20260809 02:19:17.116798 12881 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:17.116719 12882 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b7c8e1962d6a4b578e972f41ded60f1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7c8e1962d6a4b578e972f41ded60f1a" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 37369 } } }
I20260809 02:19:17.116963 12882 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:17.117008 12887 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:19:17.117937 12887 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 02:19:17 dist-test-slave-w206 krb5kdc[12778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241956, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:17.119624 12887 catalog_manager.cc:1347] Generated new cluster ID: b3392b84380f4f73a49580886e904757
I20260809 02:19:17.119678 12887 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:19:17.124279 12879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.111999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48036 (local address 127.11.93.190:37369)
0809 02:19:17.112210 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:17.112217 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:17.112269 (+ 52us) server_negotiation.cc:407] Connection header received
0809 02:19:17.112918 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:17.112928 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:17.112992 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:17.113151 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:17.113817 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.115417 (+ 1600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.116334 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.116935 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.117044 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.120169 (+ 3125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:17.120173 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:17.120173 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:17.120184 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:17.122162 (+ 1978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:17.122593 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:17.122596 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:17.122596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:17.122714 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:17.122944 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:17.122945 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:17.122945 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:17.123252 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:17.123859 (+ 607us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:17.123938 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 02:19:17.124077 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":83,"threads_started":1}
I20260809 02:19:17.127967 12887 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:19:17.128701 12887 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:19:17.132719 12887 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a: Generated new TSK 0
I20260809 02:19:17.132898 12887 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.93.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
I20260809 02:19:17.163972 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:37369
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:42041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:17.272238 12902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:17.272444 12902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:17.272468 12902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:17.273741 12902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:17.273782 12902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:17.273803 12902 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:19:17.273821 12902 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:19:17.275354 12902 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:42041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.93.190:37369
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12902
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:17.275606 12902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:17.275838 12902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:17.281687 12908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:17.281826 12902 server_base.cc:1034] running on GCE node
W20260809 02:19:17.281690 12910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:17.281970 12907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:17.282199 12902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:17.282452 12902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:17.283566 12902 hybrid_clock.cc:648] HybridClock initialized: now 1786241957283538 us; error 43 us; skew 500 ppm
Aug 09 02:19:17 dist-test-slave-w206 krb5kdc[12778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241957, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:17.286351 12902 init.cc:377] Logged in from keytab as kudu/127.11.93.129@KRBTEST.COM (short username kudu)
I20260809 02:19:17.286780 12902 webserver.cc:460] Webserver started at http://127.11.93.129:42875/ using document root <none> and password file <none>
I20260809 02:19:17.287056 12902 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:17.287106 12902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:17.287199 12902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:17.288228 12902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f"
format_stamp: "Formatted at 2026-08-09 02:19:17 on dist-test-slave-w206"
server_key: "28569c6e4df80e53754563000980d086"
server_key_iv: "35b39dadda6ad6dbc9858e5468546288"
server_key_version: "encryptionkey@0"
I20260809 02:19:17.288532 12902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f"
format_stamp: "Formatted at 2026-08-09 02:19:17 on dist-test-slave-w206"
server_key: "28569c6e4df80e53754563000980d086"
server_key_iv: "35b39dadda6ad6dbc9858e5468546288"
server_key_version: "encryptionkey@0"
I20260809 02:19:17.289880 12902 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:19:17.290674 12918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:17.290863 12902 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:19:17.290988 12902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f"
format_stamp: "Formatted at 2026-08-09 02:19:17 on dist-test-slave-w206"
server_key: "28569c6e4df80e53754563000980d086"
server_key_iv: "35b39dadda6ad6dbc9858e5468546288"
server_key_version: "encryptionkey@0"
I20260809 02:19:17.291095 12902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:17.311264 12902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:17.313220 12902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:17.313401 12902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:17.313938 12902 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:17.314000 12902 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:17.314038 12902 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:17.314086 12902 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:19:17 dist-test-slave-w206 krb5kdc[12778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241957, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:17.321609 12902 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:46025
I20260809 02:19:17.321671 13045 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:46025 every 8 connection(s)
I20260809 02:19:17.322014 12902 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:19:17.325109 12879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.314623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:42683 (local address 127.11.93.190:37369)
0809 02:19:17.314671 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:17.314673 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:17.314941 (+ 268us) server_negotiation.cc:407] Connection header received
0809 02:19:17.315515 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:17.315517 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:17.315532 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:17.315588 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:17.316525 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.317414 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.318617 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.319022 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.319104 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.322020 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:17.322021 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:17.322021 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:17.322028 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:17.323663 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:17.324100 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:17.324101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:17.324102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:17.324164 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:17.324437 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:17.324439 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:17.324439 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:17.324565 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:17.324647 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:17.324919 (+ 272us) server_negotiation.cc:299] Negotiation successful
0809 02:19:17.325014 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 02:19:17.325297 12928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.314618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:37369 (local address 127.11.93.129:42683)
0809 02:19:17.314803 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:17.314839 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:17.315392 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:17.315699 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:17.315704 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:17.316089 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:17.316394 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.316400 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.317517 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.317518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.318550 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.318553 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.319121 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.319122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.319295 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.319892 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:17.319900 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:17.321917 (+ 2017us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:17.323773 (+ 1856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:17.323780 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:17.323782 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:17.324016 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:17.324248 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:17.324249 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:17.324249 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:17.324362 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:17.324636 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:17.324643 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:17.324786 (+ 143us) client_negotiation.cc:769] Sending connection context
0809 02:19:17.324904 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 02:19:17.325065 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":103,"threads_started":1}
I20260809 02:19:17.325840 13046 heartbeater.cc:347] Connected to a master server at 127.11.93.190:37369
I20260809 02:19:17.325932 13046 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:17.326117 13046 heartbeater.cc:511] Master 127.11.93.190:37369 requested a full tablet report, sending...
I20260809 02:19:17.326676 12826 ts_manager.cc:194] Registered new tserver with Master: 8d0b6dbdc29c46bdbff3b25670ddb09f (127.11.93.129:46025)
I20260809 02:19:17.327661 12826 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:42683
I20260809 02:19:17.331054 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 12902
I20260809 02:19:17.331159 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:19:17.331359 11638 external_mini_cluster.cc:1428] Setting key 027cb64467d224795f6f492a23aafaac
I20260809 02:19:17.332511 12879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.327014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:44229 (local address 127.11.93.190:37369)
0809 02:19:17.327053 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:17.327055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:17.327119 (+ 64us) server_negotiation.cc:407] Connection header received
0809 02:19:17.327187 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:17.327188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:17.327195 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:17.327235 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:17.327578 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.328149 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.328832 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.329015 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.329072 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.329943 (+ 871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:17.329943 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:17.329944 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:17.329948 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:17.331329 (+ 1381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:17.331727 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:17.331728 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:17.331728 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:17.331791 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:17.331974 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:17.331975 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:17.331975 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:17.332090 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:17.332155 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:17.332349 (+ 194us) server_negotiation.cc:299] Negotiation successful
0809 02:19:17.332425 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 02:19:17.332516 13052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.326904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:37369 (local address 127.11.93.129:44229)
0809 02:19:17.327061 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:17.327072 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:17.327134 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:17.327247 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:17.327247 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:17.327451 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:17.327512 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.327513 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.328248 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.328249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.328755 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.328757 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.329086 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.329087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.329139 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.329583 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:17.329588 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:17.329869 (+ 281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:17.331410 (+ 1541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:17.331411 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:17.331411 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:17.331648 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:17.331857 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:17.331857 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:17.331857 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:17.331913 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:17.332172 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:17.332173 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:17.332221 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 02:19:17.332305 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 02:19:17.332419 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":101,"threads_started":1}
WARNING: no policy specified for kudu/127.11.93.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
I20260809 02:19:17.355825 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:37369
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:42041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:17.440027 13055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:17.440265 13055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:17.440304 13055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:17.441465 13055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:17.441531 13055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:17.441563 13055 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:19:17.441594 13055 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:19:17.443109 13055 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:42041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.93.190:37369
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13055
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:17.443378 13055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:17.443681 13055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:17.448663 13063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:17.448691 13060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:17.448675 13061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:17.448984 13055 server_base.cc:1034] running on GCE node
I20260809 02:19:17.449198 13055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:17.449396 13055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:17.450546 13055 hybrid_clock.cc:648] HybridClock initialized: now 1786241957450530 us; error 28 us; skew 500 ppm
Aug 09 02:19:17 dist-test-slave-w206 krb5kdc[12778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241957, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:17.453158 13055 init.cc:377] Logged in from keytab as kudu/127.11.93.130@KRBTEST.COM (short username kudu)
I20260809 02:19:17.453615 13055 webserver.cc:460] Webserver started at http://127.11.93.130:42427/ using document root <none> and password file <none>
I20260809 02:19:17.453864 13055 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:17.453909 13055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:17.454074 13055 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:17.455204 13055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "21c16535f944455483a1738e3358e8fc"
format_stamp: "Formatted at 2026-08-09 02:19:17 on dist-test-slave-w206"
server_key: "a514cf4ad515cd0b204926367cb694f9"
server_key_iv: "d75e20b665707cad467633cd486159fa"
server_key_version: "encryptionkey@0"
I20260809 02:19:17.455577 13055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "21c16535f944455483a1738e3358e8fc"
format_stamp: "Formatted at 2026-08-09 02:19:17 on dist-test-slave-w206"
server_key: "a514cf4ad515cd0b204926367cb694f9"
server_key_iv: "d75e20b665707cad467633cd486159fa"
server_key_version: "encryptionkey@0"
I20260809 02:19:17.456955 13055 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:19:17.457724 13070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:17.457891 13055 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:19:17.457993 13055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "21c16535f944455483a1738e3358e8fc"
format_stamp: "Formatted at 2026-08-09 02:19:17 on dist-test-slave-w206"
server_key: "a514cf4ad515cd0b204926367cb694f9"
server_key_iv: "d75e20b665707cad467633cd486159fa"
server_key_version: "encryptionkey@0"
I20260809 02:19:17.458069 13055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:17.466864 13055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:17.469148 13055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:17.469331 13055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:17.469907 13055 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:17.469966 13055 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:17.470008 13055 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:17.470036 13055 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:19:17 dist-test-slave-w206 krb5kdc[12778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241957, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:17.477708 13055 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:37061
I20260809 02:19:17.477785 13197 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:37061 every 8 connection(s)
I20260809 02:19:17.478089 13055 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:19:17.480746 12879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.470284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:34035 (local address 127.11.93.190:37369)
0809 02:19:17.470354 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:17.470357 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:17.470665 (+ 308us) server_negotiation.cc:407] Connection header received
0809 02:19:17.471396 (+ 731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:17.471397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:17.471407 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:17.471451 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:17.472358 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.472939 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.474044 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.474258 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.474333 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.477635 (+ 3302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:17.477636 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:17.477637 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:17.477644 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:17.479319 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:17.479721 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:17.479723 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:17.479723 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:17.479786 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:17.480051 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:17.480052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:17.480052 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:17.480174 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:17.480255 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:17.480539 (+ 284us) server_negotiation.cc:299] Negotiation successful
0809 02:19:17.480655 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:19:17.480846 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 13055
I20260809 02:19:17.480898 13079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.470289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:37369 (local address 127.11.93.130:34035)
0809 02:19:17.470511 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:17.470562 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:17.471284 (+ 722us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:17.471527 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:17.471533 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:17.471940 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:17.472244 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.472251 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.473036 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.473037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.473950 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.473953 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.474353 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.474355 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.474472 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.475050 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:17.475061 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:17.477513 (+ 2452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:17.479417 (+ 1904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:17.479423 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:17.479425 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:17.479646 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:17.479856 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:17.479857 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:17.479858 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:17.479982 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:17.480245 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:17.480252 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:17.480399 (+ 147us) client_negotiation.cc:769] Sending connection context
0809 02:19:17.480505 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 02:19:17.480668 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":113,"threads_started":1}
I20260809 02:19:17.480958 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:19:17.481145 11638 external_mini_cluster.cc:1428] Setting key 8f3ee560ff3fe7210a630c1c569cbed3
I20260809 02:19:17.481382 13198 heartbeater.cc:347] Connected to a master server at 127.11.93.190:37369
I20260809 02:19:17.481489 13198 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:17.481674 13198 heartbeater.cc:511] Master 127.11.93.190:37369 requested a full tablet report, sending...
I20260809 02:19:17.482087 12828 ts_manager.cc:194] Registered new tserver with Master: 21c16535f944455483a1738e3358e8fc (127.11.93.130:37061)
I20260809 02:19:17.482610 12828 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:34035
I20260809 02:19:17.488714 12879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.482452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:35443 (local address 127.11.93.190:37369)
0809 02:19:17.482490 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:17.482492 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:17.482833 (+ 341us) server_negotiation.cc:407] Connection header received
0809 02:19:17.482901 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:17.482902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:17.482911 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:17.482954 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:17.483407 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.483861 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.484832 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.485040 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.485123 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.486055 (+ 932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:17.486056 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:17.486057 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:17.486063 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:17.487496 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:17.487863 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:17.487864 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:17.487864 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:17.487924 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:17.488127 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:17.488128 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:17.488128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:17.488279 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:17.488361 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:17.488547 (+ 186us) server_negotiation.cc:299] Negotiation successful
0809 02:19:17.488619 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 02:19:17.488867 13204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.482389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:37369 (local address 127.11.93.130:35443)
0809 02:19:17.482777 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:17.482789 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:17.482847 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:17.483026 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:17.483028 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:17.483235 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:17.483314 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.483316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.483956 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.483957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.484741 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.484743 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.485126 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.485127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.485201 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.485654 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:17.485659 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:17.485945 (+ 286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:17.487598 (+ 1653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:17.487599 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:17.487600 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:17.487773 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:17.487996 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:17.487997 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:17.487997 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:17.488062 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:17.488352 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:17.488353 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:17.488400 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 02:19:17.488496 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 02:19:17.488605 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":64,"threads_started":1}
WARNING: no policy specified for kudu/127.11.93.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
I20260809 02:19:17.508160 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:37369
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:42041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:17.592160 13207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:17.592398 13207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:17.592439 13207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:17.593595 13207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:17.593659 13207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:17.593695 13207 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:19:17.593722 13207 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:19:17.595311 13207 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:42041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.93.190:37369
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13207
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:17.595590 13207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:17.595808 13207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:17.600817 13212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:17.600839 13213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:17.600939 13207 server_base.cc:1034] running on GCE node
W20260809 02:19:17.600839 13215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:17.601238 13207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:17.601492 13207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:17.602680 13207 hybrid_clock.cc:648] HybridClock initialized: now 1786241957602682 us; error 45 us; skew 500 ppm
Aug 09 02:19:17 dist-test-slave-w206 krb5kdc[12778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241957, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:17.605516 13207 init.cc:377] Logged in from keytab as kudu/127.11.93.131@KRBTEST.COM (short username kudu)
I20260809 02:19:17.605942 13207 webserver.cc:460] Webserver started at http://127.11.93.131:33517/ using document root <none> and password file <none>
I20260809 02:19:17.606179 13207 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:17.606248 13207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:17.606406 13207 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:17.607520 13207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "20c686ca9e184aad80f14c3bcf577642"
format_stamp: "Formatted at 2026-08-09 02:19:17 on dist-test-slave-w206"
server_key: "3b5224ccefa27d338a08dec2dfd36a4b"
server_key_iv: "91a39f1a1d64d4da73e0f8c96426fa5d"
server_key_version: "encryptionkey@0"
I20260809 02:19:17.607887 13207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "20c686ca9e184aad80f14c3bcf577642"
format_stamp: "Formatted at 2026-08-09 02:19:17 on dist-test-slave-w206"
server_key: "3b5224ccefa27d338a08dec2dfd36a4b"
server_key_iv: "91a39f1a1d64d4da73e0f8c96426fa5d"
server_key_version: "encryptionkey@0"
I20260809 02:19:17.609292 13207 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260809 02:19:17.609977 13222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:17.610132 13207 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:19:17.610232 13207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "20c686ca9e184aad80f14c3bcf577642"
format_stamp: "Formatted at 2026-08-09 02:19:17 on dist-test-slave-w206"
server_key: "3b5224ccefa27d338a08dec2dfd36a4b"
server_key_iv: "91a39f1a1d64d4da73e0f8c96426fa5d"
server_key_version: "encryptionkey@0"
I20260809 02:19:17.610312 13207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:17.627993 13207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:17.630479 13207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:17.630648 13207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:17.631392 13207 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:17.631488 13207 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:17.631521 13207 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:17.631539 13207 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:19:17 dist-test-slave-w206 krb5kdc[12778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241957, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:17.639169 13207 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:36103
I20260809 02:19:17.639235 13343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:36103 every 8 connection(s)
I20260809 02:19:17.639595 13207 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:19:17.641831 12879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.631765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:43017 (local address 127.11.93.190:37369)
0809 02:19:17.631809 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:17.631812 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:17.632042 (+ 230us) server_negotiation.cc:407] Connection header received
0809 02:19:17.632666 (+ 624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:17.632668 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:17.632683 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:17.632757 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:17.633496 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.634109 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.635502 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.635700 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.635773 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.638725 (+ 2952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:17.638726 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:17.638726 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:17.638733 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:17.640458 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:17.640802 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:17.640803 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:17.640803 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:17.640856 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:17.641026 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:17.641027 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:17.641027 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:17.641156 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:17.641223 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:17.641619 (+ 396us) server_negotiation.cc:299] Negotiation successful
0809 02:19:17.641706 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 02:19:17.642017 13231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.631745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:37369 (local address 127.11.93.131:43017)
0809 02:19:17.631920 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:17.631956 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:17.632494 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:17.632848 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:17.632852 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:17.633148 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:17.633395 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.633401 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.634221 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.634222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.635411 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.635414 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.635793 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.635794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.635932 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.636471 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:17.636482 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:17.638618 (+ 2136us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:17.640528 (+ 1910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:17.640533 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:17.640534 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:17.640745 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:17.640904 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:17.640904 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:17.640905 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:17.640990 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:17.641267 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:17.641279 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:17.641462 (+ 183us) client_negotiation.cc:769] Sending connection context
0809 02:19:17.641590 (+ 128us) client_negotiation.cc:240] Negotiation successful
0809 02:19:17.641755 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":79,"threads_started":1}
I20260809 02:19:17.642527 13344 heartbeater.cc:347] Connected to a master server at 127.11.93.190:37369
I20260809 02:19:17.642643 13344 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:17.642822 13344 heartbeater.cc:511] Master 127.11.93.190:37369 requested a full tablet report, sending...
I20260809 02:19:17.643232 12826 ts_manager.cc:194] Registered new tserver with Master: 20c686ca9e184aad80f14c3bcf577642 (127.11.93.131:36103)
I20260809 02:19:17.643786 12826 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:43017
I20260809 02:19:17.643946 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 13207
I20260809 02:19:17.644037 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:19:17.644213 11638 external_mini_cluster.cc:1428] Setting key 11780ee6c5885719a022f4e8f5f94061
I20260809 02:19:17.645095 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:19:17.649837 13351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.643564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:37369 (local address 127.11.93.131:43445)
0809 02:19:17.643688 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:17.643697 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:17.643748 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:17.644473 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:17.644473 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:17.644705 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:17.644771 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.644773 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.645519 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.645520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.646046 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.646048 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.646429 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.646430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.646504 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.646940 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:17.646945 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:17.647281 (+ 336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:17.648763 (+ 1482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:17.648764 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:17.648765 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:17.648944 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:17.649175 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:17.649176 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:17.649176 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:17.649240 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:17.649503 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:17.649503 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:17.649549 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 02:19:17.649640 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 02:19:17.649743 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":67,"threads_started":1}
I20260809 02:19:17.649832 12879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.643640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:43445 (local address 127.11.93.190:37369)
0809 02:19:17.643689 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:17.643691 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:17.643742 (+ 51us) server_negotiation.cc:407] Connection header received
0809 02:19:17.644365 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:17.644366 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:17.644377 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:17.644429 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:17.644832 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.645416 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.646143 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.646338 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.646428 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.647388 (+ 960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:17.647390 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:17.647390 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:17.647404 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:17.648667 (+ 1263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:17.649029 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:17.649030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:17.649030 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:17.649092 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:17.649310 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:17.649311 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:17.649311 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:17.649432 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:17.649511 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:17.649667 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 02:19:17.649741 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
Aug 09 02:19:17 dist-test-slave-w206 krb5kdc[12778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241957, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 02:19:17 dist-test-slave-w206 krb5kdc[12778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241957, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:17.673746 12879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.666746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48048 (local address 127.11.93.190:37369)
0809 02:19:17.666798 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:17.666801 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:17.666812 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:19:17.666887 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:17.666888 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:17.666898 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:17.666955 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:17.667553 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.668046 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.668817 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.669027 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.669104 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.671369 (+ 2265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:17.671370 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:17.671371 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:17.671378 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:17.672580 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:17.672944 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:17.672946 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:17.672946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:17.673007 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:17.673211 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:17.673212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:17.673212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:17.673336 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:17.673458 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:17.673566 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 02:19:17.673643 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 02:19:17.675244 12826 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48048:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:19:17.676880 12826 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:19:17.683777 13364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.679414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40780 (local address 127.11.93.129:46025)
0809 02:19:17.679806 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:17.679810 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:17.679825 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:19:17.679965 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:17.679968 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:17.679985 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:17.680069 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:17.680208 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.681326 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.682584 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.683304 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.683408 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.683468 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:17.683626 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 02:19:17.683672 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":80,"threads_started":1}
I20260809 02:19:17.683766 13362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.679284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:46025 (local address 127.0.0.1:40780)
0809 02:19:17.679769 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:17.679781 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:17.679838 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:17.680081 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:17.680084 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:17.680086 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:17.680153 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.680154 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.681456 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.681457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.682492 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.682496 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.683399 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.683401 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.683485 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.683500 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 02:19:17.683607 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 02:19:17.683677 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":100,"threads_started":1}
I20260809 02:19:17.683806 13366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.679597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46048 (local address 127.11.93.130:37061)
0809 02:19:17.679778 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:17.679782 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:17.679954 (+ 172us) server_negotiation.cc:407] Connection header received
0809 02:19:17.680023 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:17.680025 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:17.680041 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:17.680116 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:17.680299 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.680996 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.682508 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.683306 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.683390 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.683453 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:17.683658 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 02:19:17.683699 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":84,"threads_started":1}
I20260809 02:19:17.684109 13365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.679486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:37061 (local address 127.0.0.1:46048)
0809 02:19:17.679871 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:17.679881 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:17.679955 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:17.680185 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:17.680186 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:17.680188 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:17.680232 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.680234 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.681091 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.681092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.682407 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.682410 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.683490 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.683491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.683561 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.683565 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:19:17.683615 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 02:19:17.684043 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"mutex_wait_us":399,"thread_start_us":81,"threads_started":1}
I20260809 02:19:17.684705 12975 tablet_service.cc:1467] Processing CreateTablet for tablet 2ccda1dddec1464cbad3d7539f105650 (DEFAULT_TABLE table=test-table [id=c089a0e7861749c58148f0a566adefc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:17.684798 13128 tablet_service.cc:1467] Processing CreateTablet for tablet 2ccda1dddec1464cbad3d7539f105650 (DEFAULT_TABLE table=test-table [id=c089a0e7861749c58148f0a566adefc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:17.685034 12975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ccda1dddec1464cbad3d7539f105650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:17.685184 13128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ccda1dddec1464cbad3d7539f105650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:17.687553 13363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.679269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:36103 (local address 127.0.0.1:36216)
0809 02:19:17.679459 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:17.679500 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:17.679564 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:17.680411 (+ 847us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:17.680412 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:17.680415 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:17.680459 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.680460 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.681742 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.681743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.682918 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.682920 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.687041 (+ 4121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.687045 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.687310 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.687318 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 02:19:17.687395 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 02:19:17.687452 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":50,"threads_started":1}
I20260809 02:19:17.687889 13367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.679591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36216 (local address 127.11.93.131:36103)
0809 02:19:17.679850 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:17.679853 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:17.679860 (+ 7us) server_negotiation.cc:407] Connection header received
0809 02:19:17.680119 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:17.680122 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:17.680248 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:17.680324 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:17.680538 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.681657 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.683072 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.684141 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.684299 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.684360 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:17.687745 (+ 3385us) server_negotiation.cc:299] Negotiation successful
0809 02:19:17.687792 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":94,"threads_started":1}
I20260809 02:19:17.688369 13369 tablet_bootstrap.cc:492] T 2ccda1dddec1464cbad3d7539f105650 P 21c16535f944455483a1738e3358e8fc: Bootstrap starting.
I20260809 02:19:17.688407 13368 tablet_bootstrap.cc:492] T 2ccda1dddec1464cbad3d7539f105650 P 8d0b6dbdc29c46bdbff3b25670ddb09f: Bootstrap starting.
I20260809 02:19:17.688544 13277 tablet_service.cc:1467] Processing CreateTablet for tablet 2ccda1dddec1464cbad3d7539f105650 (DEFAULT_TABLE table=test-table [id=c089a0e7861749c58148f0a566adefc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:17.688880 13277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ccda1dddec1464cbad3d7539f105650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:17.689073 13369 tablet_bootstrap.cc:654] T 2ccda1dddec1464cbad3d7539f105650 P 21c16535f944455483a1738e3358e8fc: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:17.689097 13368 tablet_bootstrap.cc:654] T 2ccda1dddec1464cbad3d7539f105650 P 8d0b6dbdc29c46bdbff3b25670ddb09f: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:17.689443 13368 log.cc:824] T 2ccda1dddec1464cbad3d7539f105650 P 8d0b6dbdc29c46bdbff3b25670ddb09f: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:17.689437 13369 log.cc:824] T 2ccda1dddec1464cbad3d7539f105650 P 21c16535f944455483a1738e3358e8fc: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:17.690236 13369 tablet_bootstrap.cc:492] T 2ccda1dddec1464cbad3d7539f105650 P 21c16535f944455483a1738e3358e8fc: No bootstrap required, opened a new log
I20260809 02:19:17.690310 13369 ts_tablet_manager.cc:1397] T 2ccda1dddec1464cbad3d7539f105650 P 21c16535f944455483a1738e3358e8fc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:19:17.690498 13368 tablet_bootstrap.cc:492] T 2ccda1dddec1464cbad3d7539f105650 P 8d0b6dbdc29c46bdbff3b25670ddb09f: No bootstrap required, opened a new log
I20260809 02:19:17.690567 13368 ts_tablet_manager.cc:1397] T 2ccda1dddec1464cbad3d7539f105650 P 8d0b6dbdc29c46bdbff3b25670ddb09f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:19:17.692092 13373 tablet_bootstrap.cc:492] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642: Bootstrap starting.
I20260809 02:19:17.692391 13369 raft_consensus.cc:348] T 2ccda1dddec1464cbad3d7539f105650 P 21c16535f944455483a1738e3358e8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } }
I20260809 02:19:17.692566 13369 raft_consensus.cc:374] T 2ccda1dddec1464cbad3d7539f105650 P 21c16535f944455483a1738e3358e8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:17.692603 13369 raft_consensus.cc:729] T 2ccda1dddec1464cbad3d7539f105650 P 21c16535f944455483a1738e3358e8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c16535f944455483a1738e3358e8fc, State: Initialized, Role: FOLLOWER
I20260809 02:19:17.692745 13369 consensus_queue.cc:260] T 2ccda1dddec1464cbad3d7539f105650 P 21c16535f944455483a1738e3358e8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } }
I20260809 02:19:17.692726 13368 raft_consensus.cc:348] T 2ccda1dddec1464cbad3d7539f105650 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } }
I20260809 02:19:17.692862 13368 raft_consensus.cc:374] T 2ccda1dddec1464cbad3d7539f105650 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:17.692907 13368 raft_consensus.cc:729] T 2ccda1dddec1464cbad3d7539f105650 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d0b6dbdc29c46bdbff3b25670ddb09f, State: Initialized, Role: FOLLOWER
I20260809 02:19:17.692956 13373 tablet_bootstrap.cc:654] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:17.693033 13369 ts_tablet_manager.cc:1428] T 2ccda1dddec1464cbad3d7539f105650 P 21c16535f944455483a1738e3358e8fc: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 02:19:17.693050 13368 consensus_queue.cc:260] T 2ccda1dddec1464cbad3d7539f105650 P 8d0b6dbdc29c46bdbff3b25670ddb09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } }
I20260809 02:19:17.693178 13198 heartbeater.cc:503] Master 127.11.93.190:37369 was elected leader, sending a full tablet report...
I20260809 02:19:17.693346 13373 log.cc:824] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:17.693348 13046 heartbeater.cc:503] Master 127.11.93.190:37369 was elected leader, sending a full tablet report...
I20260809 02:19:17.693364 13368 ts_tablet_manager.cc:1428] T 2ccda1dddec1464cbad3d7539f105650 P 8d0b6dbdc29c46bdbff3b25670ddb09f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 02:19:17.694430 13373 tablet_bootstrap.cc:492] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642: No bootstrap required, opened a new log
I20260809 02:19:17.694502 13373 ts_tablet_manager.cc:1397] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:19:17.696115 13373 raft_consensus.cc:348] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } }
I20260809 02:19:17.696261 13373 raft_consensus.cc:374] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:17.696307 13373 raft_consensus.cc:729] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c686ca9e184aad80f14c3bcf577642, State: Initialized, Role: FOLLOWER
I20260809 02:19:17.696439 13373 consensus_queue.cc:260] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } }
I20260809 02:19:17.696681 13373 ts_tablet_manager.cc:1428] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:19:17.696753 13344 heartbeater.cc:503] Master 127.11.93.190:37369 was elected leader, sending a full tablet report...
I20260809 02:19:17.723026 13377 raft_consensus.cc:482] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:19:17.723177 13377 raft_consensus.cc:504] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } }
I20260809 02:19:17.723587 13377 leader_election.cc:288] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c16535f944455483a1738e3358e8fc (127.11.93.130:37061), 8d0b6dbdc29c46bdbff3b25670ddb09f (127.11.93.129:46025)
I20260809 02:19:17.726822 13366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.723878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:47015 (local address 127.11.93.130:37061)
0809 02:19:17.723958 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:17.723960 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:17.723970 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:19:17.724001 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:17.724002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:17.724012 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:17.724090 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:17.724292 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.724826 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.726003 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.726437 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.726494 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.726501 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:17.726701 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 02:19:17.726747 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 02:19:17.726826 13231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.723796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:37061 (local address 127.11.93.131:47015)
0809 02:19:17.723856 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:17.723869 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:17.723916 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:17.724124 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:17.724125 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:17.724127 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:17.724206 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.724208 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.724941 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.724942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.725904 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.725907 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.726517 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.726518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.726622 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.726625 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:19:17.726669 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 02:19:17.726719 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":101}
I20260809 02:19:17.726855 13364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.723886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:57407 (local address 127.11.93.129:46025)
0809 02:19:17.723933 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:17.723935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:17.724109 (+ 174us) server_negotiation.cc:407] Connection header received
0809 02:19:17.724145 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:17.724146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:17.724155 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:17.724216 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:17.724402 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.724938 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.726002 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.726460 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.726551 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.726561 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:17.726742 (+ 181us) server_negotiation.cc:299] Negotiation successful
0809 02:19:17.726786 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 02:19:17.726848 13378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.723796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:46025 (local address 127.11.93.131:57407)
0809 02:19:17.724021 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:17.724032 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:17.724096 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:17.724229 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:17.724230 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:17.724231 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:17.724331 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.724332 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.725009 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.725010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.725905 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.725908 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.726576 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.726577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.726638 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.726641 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:19:17.726717 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 02:19:17.726753 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":14,"thread_start_us":132,"threads_started":1}
I20260809 02:19:17.727314 12997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ccda1dddec1464cbad3d7539f105650" candidate_uuid: "20c686ca9e184aad80f14c3bcf577642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" is_pre_election: true
I20260809 02:19:17.727500 12997 raft_consensus.cc:2454] T 2ccda1dddec1464cbad3d7539f105650 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c686ca9e184aad80f14c3bcf577642 in term 0.
I20260809 02:19:17.727597 13148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ccda1dddec1464cbad3d7539f105650" candidate_uuid: "20c686ca9e184aad80f14c3bcf577642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c16535f944455483a1738e3358e8fc" is_pre_election: true
I20260809 02:19:17.727721 13224 leader_election.cc:302] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c686ca9e184aad80f14c3bcf577642, 8d0b6dbdc29c46bdbff3b25670ddb09f; no voters:
I20260809 02:19:17.727759 13148 raft_consensus.cc:2454] T 2ccda1dddec1464cbad3d7539f105650 P 21c16535f944455483a1738e3358e8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c686ca9e184aad80f14c3bcf577642 in term 0.
I20260809 02:19:17.727865 13377 raft_consensus.cc:2781] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:19:17.727931 13377 raft_consensus.cc:482] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:19:17.727954 13377 raft_consensus.cc:3037] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642 [term 0 FOLLOWER]: Advancing to term 1
W20260809 02:19:17.728727 13199 tablet.cc:2369] T 2ccda1dddec1464cbad3d7539f105650 P 21c16535f944455483a1738e3358e8fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:19:17.728700 13377 raft_consensus.cc:504] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } }
I20260809 02:19:17.728909 13377 leader_election.cc:288] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642 [CANDIDATE]: Term 1 election: Requested vote from peers 21c16535f944455483a1738e3358e8fc (127.11.93.130:37061), 8d0b6dbdc29c46bdbff3b25670ddb09f (127.11.93.129:46025)
I20260809 02:19:17.728992 12997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ccda1dddec1464cbad3d7539f105650" candidate_uuid: "20c686ca9e184aad80f14c3bcf577642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f"
I20260809 02:19:17.729099 12997 raft_consensus.cc:3037] T 2ccda1dddec1464cbad3d7539f105650 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:17.729132 13148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ccda1dddec1464cbad3d7539f105650" candidate_uuid: "20c686ca9e184aad80f14c3bcf577642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c16535f944455483a1738e3358e8fc"
I20260809 02:19:17.729215 13148 raft_consensus.cc:3037] T 2ccda1dddec1464cbad3d7539f105650 P 21c16535f944455483a1738e3358e8fc [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:17.729842 12997 raft_consensus.cc:2454] T 2ccda1dddec1464cbad3d7539f105650 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c686ca9e184aad80f14c3bcf577642 in term 1.
I20260809 02:19:17.729883 13148 raft_consensus.cc:2454] T 2ccda1dddec1464cbad3d7539f105650 P 21c16535f944455483a1738e3358e8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c686ca9e184aad80f14c3bcf577642 in term 1.
I20260809 02:19:17.730406 13223 leader_election.cc:302] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c686ca9e184aad80f14c3bcf577642, 21c16535f944455483a1738e3358e8fc; no voters:
I20260809 02:19:17.730521 13377 raft_consensus.cc:2781] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:17.730669 13377 raft_consensus.cc:686] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642 [term 1 LEADER]: Becoming Leader. State: Replica: 20c686ca9e184aad80f14c3bcf577642, State: Running, Role: LEADER
I20260809 02:19:17.730760 13377 consensus_queue.cc:237] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } }
I20260809 02:19:17.731617 12826 catalog_manager.cc:5495] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c686ca9e184aad80f14c3bcf577642 (127.11.93.131). New cstate: current_term: 1 leader_uuid: "20c686ca9e184aad80f14c3bcf577642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } health_report { overall_health: UNKNOWN } } }
I20260809 02:19:17.743261 13367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.740616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36220 (local address 127.11.93.131:36103)
0809 02:19:17.740685 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:17.740687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:17.740697 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:19:17.740794 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:17.740795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:17.740812 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:17.740875 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:19:17.741051 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.741515 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.742359 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.742566 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.742642 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.742862 (+ 220us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:19:17.742958 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:19:17.743063 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:17.743139 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 02:19:17.743158 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:19:17.745281 12997 raft_consensus.cc:1261] T 2ccda1dddec1464cbad3d7539f105650 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 1 FOLLOWER]: Refusing update from remote peer 20c686ca9e184aad80f14c3bcf577642: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:17.745281 13148 raft_consensus.cc:1261] T 2ccda1dddec1464cbad3d7539f105650 P 21c16535f944455483a1738e3358e8fc [term 1 FOLLOWER]: Refusing update from remote peer 20c686ca9e184aad80f14c3bcf577642: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:17.745653 13377 consensus_queue.cc:1035] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:17.748070 13383 mvcc.cc:205] Tried to move back new op lower bound from 7316447058921926656 to 7316447058865917952. Current Snapshot: MvccSnapshot[applied={T|T < 7316447058921926656}]
I20260809 02:19:17.748064 13379 consensus_queue.cc:1035] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:17.751861 12826 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48048:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:17.751972 12826 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48048:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:17.752866 12826 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a: Sending DeleteTablet for 3 replicas of tablet 2ccda1dddec1464cbad3d7539f105650
I20260809 02:19:17.753302 13277 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ccda1dddec1464cbad3d7539f105650 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:17 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:36216
I20260809 02:19:17.753328 12975 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ccda1dddec1464cbad3d7539f105650 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:17 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:40780
I20260809 02:19:17.753490 13391 tablet_replica.cc:330] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642: stopping tablet replica
I20260809 02:19:17.753551 13391 raft_consensus.cc:2229] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:19:17.753633 13391 raft_consensus.cc:2258] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:17.754024 13391 ts_tablet_manager.cc:1905] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:17.754004 12826 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48048:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:19:17.754140 12826 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:19:17.755311 13277 tablet_service.cc:1467] Processing CreateTablet for tablet 77b5db1de4ad483283c82811d64ed248 (DEFAULT_TABLE table=test-table [id=9d8272eadae84942adab3171c37a72de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:17.755390 13128 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ccda1dddec1464cbad3d7539f105650 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:17 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:46048
I20260809 02:19:17.755439 13277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77b5db1de4ad483283c82811d64ed248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:17.755808 13393 tablet_replica.cc:330] T 2ccda1dddec1464cbad3d7539f105650 P 21c16535f944455483a1738e3358e8fc: stopping tablet replica
I20260809 02:19:17.755900 13393 raft_consensus.cc:2229] T 2ccda1dddec1464cbad3d7539f105650 P 21c16535f944455483a1738e3358e8fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:17.756001 13393 raft_consensus.cc:2258] T 2ccda1dddec1464cbad3d7539f105650 P 21c16535f944455483a1738e3358e8fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:17.756443 13393 ts_tablet_manager.cc:1905] T 2ccda1dddec1464cbad3d7539f105650 P 21c16535f944455483a1738e3358e8fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:17.756565 13391 ts_tablet_manager.cc:1918] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:19:17.756625 13391 log.cc:1196] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/2ccda1dddec1464cbad3d7539f105650
I20260809 02:19:17.756820 13373 tablet_bootstrap.cc:492] T 77b5db1de4ad483283c82811d64ed248 P 20c686ca9e184aad80f14c3bcf577642: Bootstrap starting.
I20260809 02:19:17.756898 13391 ts_tablet_manager.cc:1939] T 2ccda1dddec1464cbad3d7539f105650 P 20c686ca9e184aad80f14c3bcf577642: Deleting consensus metadata
I20260809 02:19:17.757086 13392 tablet_replica.cc:330] T 2ccda1dddec1464cbad3d7539f105650 P 8d0b6dbdc29c46bdbff3b25670ddb09f: stopping tablet replica
I20260809 02:19:17.757186 13392 raft_consensus.cc:2229] T 2ccda1dddec1464cbad3d7539f105650 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:17.757285 13392 raft_consensus.cc:2258] T 2ccda1dddec1464cbad3d7539f105650 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:17.757287 13373 tablet_bootstrap.cc:654] T 77b5db1de4ad483283c82811d64ed248 P 20c686ca9e184aad80f14c3bcf577642: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:17.757877 13128 tablet_service.cc:1467] Processing CreateTablet for tablet 77b5db1de4ad483283c82811d64ed248 (DEFAULT_TABLE table=test-table [id=9d8272eadae84942adab3171c37a72de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:17.757997 13128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77b5db1de4ad483283c82811d64ed248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:17.757997 13392 ts_tablet_manager.cc:1905] T 2ccda1dddec1464cbad3d7539f105650 P 8d0b6dbdc29c46bdbff3b25670ddb09f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:17.758103 13393 ts_tablet_manager.cc:1918] T 2ccda1dddec1464cbad3d7539f105650 P 21c16535f944455483a1738e3358e8fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:19:17.758164 13393 log.cc:1196] T 2ccda1dddec1464cbad3d7539f105650 P 21c16535f944455483a1738e3358e8fc: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/2ccda1dddec1464cbad3d7539f105650
I20260809 02:19:17.758421 13393 ts_tablet_manager.cc:1939] T 2ccda1dddec1464cbad3d7539f105650 P 21c16535f944455483a1738e3358e8fc: Deleting consensus metadata
I20260809 02:19:17.759081 12808 catalog_manager.cc:4841] TS 21c16535f944455483a1738e3358e8fc (127.11.93.130:37061): tablet 2ccda1dddec1464cbad3d7539f105650 (table test-table [id=c089a0e7861749c58148f0a566adefc4]) successfully deleted
I20260809 02:19:17.759228 13369 tablet_bootstrap.cc:492] T 77b5db1de4ad483283c82811d64ed248 P 21c16535f944455483a1738e3358e8fc: Bootstrap starting.
I20260809 02:19:17.759558 12975 tablet_service.cc:1467] Processing CreateTablet for tablet 77b5db1de4ad483283c82811d64ed248 (DEFAULT_TABLE table=test-table [id=9d8272eadae84942adab3171c37a72de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:17.759640 13369 tablet_bootstrap.cc:654] T 77b5db1de4ad483283c82811d64ed248 P 21c16535f944455483a1738e3358e8fc: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:17.759660 12975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77b5db1de4ad483283c82811d64ed248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:17.760288 13369 tablet_bootstrap.cc:492] T 77b5db1de4ad483283c82811d64ed248 P 21c16535f944455483a1738e3358e8fc: No bootstrap required, opened a new log
I20260809 02:19:17.760334 13369 ts_tablet_manager.cc:1397] T 77b5db1de4ad483283c82811d64ed248 P 21c16535f944455483a1738e3358e8fc: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 02:19:17.760490 13369 raft_consensus.cc:348] T 77b5db1de4ad483283c82811d64ed248 P 21c16535f944455483a1738e3358e8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } }
I20260809 02:19:17.760555 13369 raft_consensus.cc:374] T 77b5db1de4ad483283c82811d64ed248 P 21c16535f944455483a1738e3358e8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:17.760574 13369 raft_consensus.cc:729] T 77b5db1de4ad483283c82811d64ed248 P 21c16535f944455483a1738e3358e8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c16535f944455483a1738e3358e8fc, State: Initialized, Role: FOLLOWER
I20260809 02:19:17.760609 13369 consensus_queue.cc:260] T 77b5db1de4ad483283c82811d64ed248 P 21c16535f944455483a1738e3358e8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } }
I20260809 02:19:17.760694 13369 ts_tablet_manager.cc:1428] T 77b5db1de4ad483283c82811d64ed248 P 21c16535f944455483a1738e3358e8fc: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:17.760995 13368 tablet_bootstrap.cc:492] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f: Bootstrap starting.
I20260809 02:19:17.761411 13368 tablet_bootstrap.cc:654] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:17.761539 13392 ts_tablet_manager.cc:1918] T 2ccda1dddec1464cbad3d7539f105650 P 8d0b6dbdc29c46bdbff3b25670ddb09f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:19:17.761624 13392 log.cc:1196] T 2ccda1dddec1464cbad3d7539f105650 P 8d0b6dbdc29c46bdbff3b25670ddb09f: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-0/wal/wals/2ccda1dddec1464cbad3d7539f105650
I20260809 02:19:17.762126 13392 ts_tablet_manager.cc:1939] T 2ccda1dddec1464cbad3d7539f105650 P 8d0b6dbdc29c46bdbff3b25670ddb09f: Deleting consensus metadata
I20260809 02:19:17.762244 13373 tablet_bootstrap.cc:492] T 77b5db1de4ad483283c82811d64ed248 P 20c686ca9e184aad80f14c3bcf577642: No bootstrap required, opened a new log
I20260809 02:19:17.762292 13373 ts_tablet_manager.cc:1397] T 77b5db1de4ad483283c82811d64ed248 P 20c686ca9e184aad80f14c3bcf577642: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260809 02:19:17.762450 13373 raft_consensus.cc:348] T 77b5db1de4ad483283c82811d64ed248 P 20c686ca9e184aad80f14c3bcf577642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } }
I20260809 02:19:17.762523 13373 raft_consensus.cc:374] T 77b5db1de4ad483283c82811d64ed248 P 20c686ca9e184aad80f14c3bcf577642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:17.762512 12811 catalog_manager.cc:4841] TS 8d0b6dbdc29c46bdbff3b25670ddb09f (127.11.93.129:46025): tablet 2ccda1dddec1464cbad3d7539f105650 (table test-table [id=c089a0e7861749c58148f0a566adefc4]) successfully deleted
I20260809 02:19:17.762552 13373 raft_consensus.cc:729] T 77b5db1de4ad483283c82811d64ed248 P 20c686ca9e184aad80f14c3bcf577642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c686ca9e184aad80f14c3bcf577642, State: Initialized, Role: FOLLOWER
I20260809 02:19:17.762595 13373 consensus_queue.cc:260] T 77b5db1de4ad483283c82811d64ed248 P 20c686ca9e184aad80f14c3bcf577642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } }
I20260809 02:19:17.762681 13373 ts_tablet_manager.cc:1428] T 77b5db1de4ad483283c82811d64ed248 P 20c686ca9e184aad80f14c3bcf577642: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 02:19:17.762835 12808 catalog_manager.cc:4841] TS 20c686ca9e184aad80f14c3bcf577642 (127.11.93.131:36103): tablet 2ccda1dddec1464cbad3d7539f105650 (table test-table [id=c089a0e7861749c58148f0a566adefc4]) successfully deleted
I20260809 02:19:17.763330 13368 tablet_bootstrap.cc:492] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f: No bootstrap required, opened a new log
I20260809 02:19:17.763372 13368 ts_tablet_manager.cc:1397] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:19:17.763520 13368 raft_consensus.cc:348] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } }
I20260809 02:19:17.763584 13368 raft_consensus.cc:374] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:17.763599 13368 raft_consensus.cc:729] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d0b6dbdc29c46bdbff3b25670ddb09f, State: Initialized, Role: FOLLOWER
I20260809 02:19:17.763652 13368 consensus_queue.cc:260] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } }
I20260809 02:19:17.763741 13368 ts_tablet_manager.cc:1428] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260809 02:19:17.823128 13047 tablet.cc:2369] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:19:17.832248 13375 raft_consensus.cc:482] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:19:17.832382 13375 raft_consensus.cc:504] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } }
I20260809 02:19:17.832717 13375 leader_election.cc:288] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c16535f944455483a1738e3358e8fc (127.11.93.130:37061), 20c686ca9e184aad80f14c3bcf577642 (127.11.93.131:36103)
I20260809 02:19:17.836529 13366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.833023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:43209 (local address 127.11.93.130:37061)
0809 02:19:17.833095 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:17.833098 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:17.833216 (+ 118us) server_negotiation.cc:407] Connection header received
0809 02:19:17.833335 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:17.833336 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:17.833348 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:17.833395 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:17.833679 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.834424 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.835549 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.836080 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.836163 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.836174 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:17.836390 (+ 216us) server_negotiation.cc:299] Negotiation successful
0809 02:19:17.836447 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:19:17.836762 13398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.832897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:37061 (local address 127.11.93.129:43209)
0809 02:19:17.833145 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:17.833157 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:17.833247 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:17.833469 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:17.833470 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:17.833473 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:17.833591 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.833595 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.834514 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.834515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.835416 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.835418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.836214 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.836215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.836297 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.836302 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:19:17.836624 (+ 322us) client_negotiation.cc:240] Negotiation successful
0809 02:19:17.836673 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":28,"thread_start_us":74,"threads_started":1}
I20260809 02:19:17.836992 13367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.833210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:35277 (local address 127.11.93.131:36103)
0809 02:19:17.833260 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:17.833262 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:17.833308 (+ 46us) server_negotiation.cc:407] Connection header received
0809 02:19:17.833373 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:17.833374 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:17.833386 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:17.833465 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:17.834550 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.835249 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.836175 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.836546 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.836659 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.836669 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:17.836880 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 02:19:17.836928 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 02:19:17.837013 13399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.833072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:36103 (local address 127.11.93.129:35277)
0809 02:19:17.833259 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:17.833267 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:17.833318 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:17.833470 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:17.833471 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:17.833477 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:17.833591 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.833594 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.835342 (+ 1748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.835343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.836080 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.836083 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.836700 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.836701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.836784 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.836789 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:19:17.836861 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 02:19:17.836901 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":17,"thread_start_us":40,"threads_started":1}
I20260809 02:19:17.837081 13148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77b5db1de4ad483283c82811d64ed248" candidate_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c16535f944455483a1738e3358e8fc" is_pre_election: true
I20260809 02:19:17.837173 13148 raft_consensus.cc:2454] T 77b5db1de4ad483283c82811d64ed248 P 21c16535f944455483a1738e3358e8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d0b6dbdc29c46bdbff3b25670ddb09f in term 0.
I20260809 02:19:17.837369 12919 leader_election.cc:302] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c16535f944455483a1738e3358e8fc, 8d0b6dbdc29c46bdbff3b25670ddb09f; no voters:
I20260809 02:19:17.837522 13375 raft_consensus.cc:2781] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:19:17.837556 13375 raft_consensus.cc:482] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:19:17.837488 13297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77b5db1de4ad483283c82811d64ed248" candidate_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c686ca9e184aad80f14c3bcf577642" is_pre_election: true
I20260809 02:19:17.837582 13375 raft_consensus.cc:3037] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:17.837621 13297 raft_consensus.cc:2454] T 77b5db1de4ad483283c82811d64ed248 P 20c686ca9e184aad80f14c3bcf577642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d0b6dbdc29c46bdbff3b25670ddb09f in term 0.
I20260809 02:19:17.838410 13375 raft_consensus.cc:504] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } }
I20260809 02:19:17.838557 13375 leader_election.cc:288] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f [CANDIDATE]: Term 1 election: Requested vote from peers 21c16535f944455483a1738e3358e8fc (127.11.93.130:37061), 20c686ca9e184aad80f14c3bcf577642 (127.11.93.131:36103)
I20260809 02:19:17.838706 13148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77b5db1de4ad483283c82811d64ed248" candidate_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c16535f944455483a1738e3358e8fc"
I20260809 02:19:17.838725 13297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77b5db1de4ad483283c82811d64ed248" candidate_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c686ca9e184aad80f14c3bcf577642"
I20260809 02:19:17.838804 13297 raft_consensus.cc:3037] T 77b5db1de4ad483283c82811d64ed248 P 20c686ca9e184aad80f14c3bcf577642 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:17.838806 13148 raft_consensus.cc:3037] T 77b5db1de4ad483283c82811d64ed248 P 21c16535f944455483a1738e3358e8fc [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:17.839478 13148 raft_consensus.cc:2454] T 77b5db1de4ad483283c82811d64ed248 P 21c16535f944455483a1738e3358e8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d0b6dbdc29c46bdbff3b25670ddb09f in term 1.
I20260809 02:19:17.839640 12919 leader_election.cc:302] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c16535f944455483a1738e3358e8fc, 8d0b6dbdc29c46bdbff3b25670ddb09f; no voters:
I20260809 02:19:17.839781 13375 raft_consensus.cc:2781] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:17.839794 13297 raft_consensus.cc:2454] T 77b5db1de4ad483283c82811d64ed248 P 20c686ca9e184aad80f14c3bcf577642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d0b6dbdc29c46bdbff3b25670ddb09f in term 1.
I20260809 02:19:17.839962 13375 raft_consensus.cc:686] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 1 LEADER]: Becoming Leader. State: Replica: 8d0b6dbdc29c46bdbff3b25670ddb09f, State: Running, Role: LEADER
I20260809 02:19:17.840036 13375 consensus_queue.cc:237] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } }
I20260809 02:19:17.840818 12826 catalog_manager.cc:5495] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d0b6dbdc29c46bdbff3b25670ddb09f (127.11.93.129). New cstate: current_term: 1 leader_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } health_report { overall_health: UNKNOWN } } }
Aug 09 02:19:17 dist-test-slave-w206 krb5kdc[12778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241957, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:17.878777 13407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.871899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:37369 (local address 127.0.0.1:48050)
0809 02:19:17.872063 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:17.872075 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:17.872171 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:17.872333 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:17.872334 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:17.872662 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:17.872710 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.872714 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.873370 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.873371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.873893 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.873895 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.874239 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.874240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.874300 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.874802 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:17.874806 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:17.876259 (+ 1453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:17.877627 (+ 1368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:17.877635 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:17.877637 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:17.877825 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:17.878050 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:17.878051 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:17.878052 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:17.878114 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:17.878367 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:17.878375 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:17.878420 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 02:19:17.878506 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 02:19:17.878644 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":2,"thread_start_us":82,"threads_started":1}
I20260809 02:19:17.878819 12879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.871991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48050 (local address 127.11.93.190:37369)
0809 02:19:17.872052 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:17.872055 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:17.872150 (+ 95us) server_negotiation.cc:407] Connection header received
0809 02:19:17.872243 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:17.872244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:17.872255 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:17.872330 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:17.872803 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.873286 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.873989 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.874169 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.874242 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.876349 (+ 2107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:17.876351 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:17.876351 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:17.876358 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:17.877531 (+ 1173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:17.877925 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:17.877926 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:17.877926 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:17.877983 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:17.878179 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:17.878180 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:17.878181 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:17.878293 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:17.878365 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:17.878531 (+ 166us) server_negotiation.cc:299] Negotiation successful
0809 02:19:17.878709 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":106,"server-negotiator.queue_time_us":35}
I20260809 02:19:17.880824 12826 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:48050:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 02:19:17.881102 12826 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:19:17.882725 13277 tablet_service.cc:1467] Processing CreateTablet for tablet 28c1a20e09214ee492b7747ccb0cb290 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4eeb31fa421f4c198cba73e3251238e3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:19:17.882671 12975 tablet_service.cc:1467] Processing CreateTablet for tablet 28c1a20e09214ee492b7747ccb0cb290 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4eeb31fa421f4c198cba73e3251238e3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:19:17.882750 13128 tablet_service.cc:1467] Processing CreateTablet for tablet 28c1a20e09214ee492b7747ccb0cb290 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4eeb31fa421f4c198cba73e3251238e3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:19:17.882884 13277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28c1a20e09214ee492b7747ccb0cb290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:17.882901 13128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28c1a20e09214ee492b7747ccb0cb290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:17.882913 12975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28c1a20e09214ee492b7747ccb0cb290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:17.884466 13369 tablet_bootstrap.cc:492] T 28c1a20e09214ee492b7747ccb0cb290 P 21c16535f944455483a1738e3358e8fc: Bootstrap starting.
I20260809 02:19:17.884472 13373 tablet_bootstrap.cc:492] T 28c1a20e09214ee492b7747ccb0cb290 P 20c686ca9e184aad80f14c3bcf577642: Bootstrap starting.
I20260809 02:19:17.884831 13368 tablet_bootstrap.cc:492] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f: Bootstrap starting.
I20260809 02:19:17.884842 13373 tablet_bootstrap.cc:654] T 28c1a20e09214ee492b7747ccb0cb290 P 20c686ca9e184aad80f14c3bcf577642: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:17.884905 13369 tablet_bootstrap.cc:654] T 28c1a20e09214ee492b7747ccb0cb290 P 21c16535f944455483a1738e3358e8fc: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:17.885273 13368 tablet_bootstrap.cc:654] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:17.885593 13369 tablet_bootstrap.cc:492] T 28c1a20e09214ee492b7747ccb0cb290 P 21c16535f944455483a1738e3358e8fc: No bootstrap required, opened a new log
I20260809 02:19:17.885613 13373 tablet_bootstrap.cc:492] T 28c1a20e09214ee492b7747ccb0cb290 P 20c686ca9e184aad80f14c3bcf577642: No bootstrap required, opened a new log
I20260809 02:19:17.885664 13373 ts_tablet_manager.cc:1397] T 28c1a20e09214ee492b7747ccb0cb290 P 20c686ca9e184aad80f14c3bcf577642: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:17.885656 13369 ts_tablet_manager.cc:1397] T 28c1a20e09214ee492b7747ccb0cb290 P 21c16535f944455483a1738e3358e8fc: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 02:19:17.885774 13373 raft_consensus.cc:348] T 28c1a20e09214ee492b7747ccb0cb290 P 20c686ca9e184aad80f14c3bcf577642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } }
I20260809 02:19:17.885869 13373 raft_consensus.cc:374] T 28c1a20e09214ee492b7747ccb0cb290 P 20c686ca9e184aad80f14c3bcf577642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:17.885896 13373 raft_consensus.cc:729] T 28c1a20e09214ee492b7747ccb0cb290 P 20c686ca9e184aad80f14c3bcf577642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c686ca9e184aad80f14c3bcf577642, State: Initialized, Role: FOLLOWER
I20260809 02:19:17.885848 13369 raft_consensus.cc:348] T 28c1a20e09214ee492b7747ccb0cb290 P 21c16535f944455483a1738e3358e8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } }
I20260809 02:19:17.885962 13369 raft_consensus.cc:374] T 28c1a20e09214ee492b7747ccb0cb290 P 21c16535f944455483a1738e3358e8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:17.885967 13368 tablet_bootstrap.cc:492] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f: No bootstrap required, opened a new log
I20260809 02:19:17.885946 13373 consensus_queue.cc:260] T 28c1a20e09214ee492b7747ccb0cb290 P 20c686ca9e184aad80f14c3bcf577642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } }
I20260809 02:19:17.885987 13369 raft_consensus.cc:729] T 28c1a20e09214ee492b7747ccb0cb290 P 21c16535f944455483a1738e3358e8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c16535f944455483a1738e3358e8fc, State: Initialized, Role: FOLLOWER
I20260809 02:19:17.886008 13368 ts_tablet_manager.cc:1397] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:17.886047 13373 ts_tablet_manager.cc:1428] T 28c1a20e09214ee492b7747ccb0cb290 P 20c686ca9e184aad80f14c3bcf577642: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 02:19:17.886039 13369 consensus_queue.cc:260] T 28c1a20e09214ee492b7747ccb0cb290 P 21c16535f944455483a1738e3358e8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } }
I20260809 02:19:17.886135 13369 ts_tablet_manager.cc:1428] T 28c1a20e09214ee492b7747ccb0cb290 P 21c16535f944455483a1738e3358e8fc: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:17.886153 13379 tablet_replica.cc:439] T 28c1a20e09214ee492b7747ccb0cb290 P 20c686ca9e184aad80f14c3bcf577642: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } } }
I20260809 02:19:17.886163 13368 raft_consensus.cc:348] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } }
I20260809 02:19:17.886229 13368 raft_consensus.cc:374] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:17.886232 13379 tablet_replica.cc:442] T 28c1a20e09214ee492b7747ccb0cb290 P 20c686ca9e184aad80f14c3bcf577642: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:19:17.886262 13368 raft_consensus.cc:729] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d0b6dbdc29c46bdbff3b25670ddb09f, State: Initialized, Role: FOLLOWER
I20260809 02:19:17.886313 13368 consensus_queue.cc:260] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } }
I20260809 02:19:17.886451 13368 ts_tablet_manager.cc:1428] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:17.886422 13374 tablet_replica.cc:439] T 28c1a20e09214ee492b7747ccb0cb290 P 21c16535f944455483a1738e3358e8fc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } } }
I20260809 02:19:17.886518 13374 tablet_replica.cc:442] T 28c1a20e09214ee492b7747ccb0cb290 P 21c16535f944455483a1738e3358e8fc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:19:17.886514 13400 tablet_replica.cc:439] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } } }
I20260809 02:19:17.886624 13400 tablet_replica.cc:442] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f: This TxnStatusTablet replica's current role is: FOLLOWER
W20260809 02:19:17.890749 13346 tablet.cc:2369] T 28c1a20e09214ee492b7747ccb0cb290 P 20c686ca9e184aad80f14c3bcf577642: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:19:17.911059 13400 raft_consensus.cc:482] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:19:17.911180 13400 raft_consensus.cc:504] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } }
I20260809 02:19:17.911361 13400 leader_election.cc:288] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c16535f944455483a1738e3358e8fc (127.11.93.130:37061), 20c686ca9e184aad80f14c3bcf577642 (127.11.93.131:36103)
I20260809 02:19:17.911648 13148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28c1a20e09214ee492b7747ccb0cb290" candidate_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c16535f944455483a1738e3358e8fc" is_pre_election: true
I20260809 02:19:17.911664 13297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28c1a20e09214ee492b7747ccb0cb290" candidate_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c686ca9e184aad80f14c3bcf577642" is_pre_election: true
I20260809 02:19:17.911757 13148 raft_consensus.cc:2454] T 28c1a20e09214ee492b7747ccb0cb290 P 21c16535f944455483a1738e3358e8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d0b6dbdc29c46bdbff3b25670ddb09f in term 0.
I20260809 02:19:17.911779 13297 raft_consensus.cc:2454] T 28c1a20e09214ee492b7747ccb0cb290 P 20c686ca9e184aad80f14c3bcf577642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d0b6dbdc29c46bdbff3b25670ddb09f in term 0.
I20260809 02:19:17.911960 12919 leader_election.cc:302] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c686ca9e184aad80f14c3bcf577642, 8d0b6dbdc29c46bdbff3b25670ddb09f; no voters:
I20260809 02:19:17.912083 13400 raft_consensus.cc:2781] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:19:17.912158 13400 raft_consensus.cc:482] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:19:17.912190 13400 raft_consensus.cc:3037] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:17.913094 13400 raft_consensus.cc:504] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } }
I20260809 02:19:17.913234 13400 leader_election.cc:288] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f [CANDIDATE]: Term 1 election: Requested vote from peers 21c16535f944455483a1738e3358e8fc (127.11.93.130:37061), 20c686ca9e184aad80f14c3bcf577642 (127.11.93.131:36103)
I20260809 02:19:17.913440 13297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28c1a20e09214ee492b7747ccb0cb290" candidate_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c686ca9e184aad80f14c3bcf577642"
I20260809 02:19:17.913430 13148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28c1a20e09214ee492b7747ccb0cb290" candidate_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c16535f944455483a1738e3358e8fc"
I20260809 02:19:17.913511 13148 raft_consensus.cc:3037] T 28c1a20e09214ee492b7747ccb0cb290 P 21c16535f944455483a1738e3358e8fc [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:17.913509 13297 raft_consensus.cc:3037] T 28c1a20e09214ee492b7747ccb0cb290 P 20c686ca9e184aad80f14c3bcf577642 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:17.914290 13297 raft_consensus.cc:2454] T 28c1a20e09214ee492b7747ccb0cb290 P 20c686ca9e184aad80f14c3bcf577642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d0b6dbdc29c46bdbff3b25670ddb09f in term 1.
I20260809 02:19:17.914290 13148 raft_consensus.cc:2454] T 28c1a20e09214ee492b7747ccb0cb290 P 21c16535f944455483a1738e3358e8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d0b6dbdc29c46bdbff3b25670ddb09f in term 1.
I20260809 02:19:17.914462 12919 leader_election.cc:302] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c686ca9e184aad80f14c3bcf577642, 8d0b6dbdc29c46bdbff3b25670ddb09f; no voters:
I20260809 02:19:17.914567 13400 raft_consensus.cc:2781] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:17.914625 13400 raft_consensus.cc:686] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 1 LEADER]: Becoming Leader. State: Replica: 8d0b6dbdc29c46bdbff3b25670ddb09f, State: Running, Role: LEADER
I20260809 02:19:17.914675 13400 consensus_queue.cc:237] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } }
I20260809 02:19:17.915010 13375 tablet_replica.cc:439] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f: TxnStatusTablet state changed. Reason: New leader 8d0b6dbdc29c46bdbff3b25670ddb09f. Latest consensus state: current_term: 1 leader_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } } }
I20260809 02:19:17.915104 13375 tablet_replica.cc:442] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:19:17.915307 13412 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 02:19:17.915331 12825 catalog_manager.cc:5495] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d0b6dbdc29c46bdbff3b25670ddb09f (127.11.93.129). New cstate: current_term: 1 leader_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } health_report { overall_health: UNKNOWN } } }
I20260809 02:19:17.915442 13412 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 02:19:17.924710 13364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.922193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40796 (local address 127.11.93.129:46025)
0809 02:19:17.922256 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:17.922258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:17.922267 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:19:17.922376 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:17.922377 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:17.922396 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:17.922481 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:19:17.922617 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.923147 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.923899 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.924090 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.924168 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.924351 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:19:17.924452 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:19:17.924532 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:17.924596 (+ 64us) server_negotiation.cc:299] Negotiation successful
0809 02:19:17.924617 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:19:17.924701 13407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.922127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:46025 (local address 127.0.0.1:40796)
0809 02:19:17.922207 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:17.922235 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:17.922283 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:17.922487 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:17.922489 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:17.922490 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:19:17.922541 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.922543 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.923242 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.923243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.923809 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.923811 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.924167 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.924168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.924235 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.924258 (+ 23us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:19:17.924531 (+ 273us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:19:17.924542 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 02:19:17.924582 (+ 40us) client_negotiation.cc:240] Negotiation successful
0809 02:19:17.924629 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 02:19:17.926013 13148 raft_consensus.cc:1261] T 28c1a20e09214ee492b7747ccb0cb290 P 21c16535f944455483a1738e3358e8fc [term 1 FOLLOWER]: Refusing update from remote peer 8d0b6dbdc29c46bdbff3b25670ddb09f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:17.926098 13297 raft_consensus.cc:1261] T 28c1a20e09214ee492b7747ccb0cb290 P 20c686ca9e184aad80f14c3bcf577642 [term 1 FOLLOWER]: Refusing update from remote peer 8d0b6dbdc29c46bdbff3b25670ddb09f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:17.926352 13375 consensus_queue.cc:1035] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:17.926469 13400 consensus_queue.cc:1035] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:17.927119 13379 tablet_replica.cc:439] T 28c1a20e09214ee492b7747ccb0cb290 P 20c686ca9e184aad80f14c3bcf577642: TxnStatusTablet state changed. Reason: New leader 8d0b6dbdc29c46bdbff3b25670ddb09f. Latest consensus state: current_term: 1 leader_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } } }
I20260809 02:19:17.927217 13379 tablet_replica.cc:442] T 28c1a20e09214ee492b7747ccb0cb290 P 20c686ca9e184aad80f14c3bcf577642: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:19:17.927237 13374 tablet_replica.cc:439] T 28c1a20e09214ee492b7747ccb0cb290 P 21c16535f944455483a1738e3358e8fc: TxnStatusTablet state changed. Reason: New leader 8d0b6dbdc29c46bdbff3b25670ddb09f. Latest consensus state: current_term: 1 leader_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } } }
I20260809 02:19:17.927313 13374 tablet_replica.cc:442] T 28c1a20e09214ee492b7747ccb0cb290 P 21c16535f944455483a1738e3358e8fc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:19:17.928067 13375 tablet_replica.cc:439] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } } }
I20260809 02:19:17.928145 13375 tablet_replica.cc:442] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:19:17.928282 13374 tablet_replica.cc:439] T 28c1a20e09214ee492b7747ccb0cb290 P 21c16535f944455483a1738e3358e8fc: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } } }
I20260809 02:19:17.928428 13374 tablet_replica.cc:442] T 28c1a20e09214ee492b7747ccb0cb290 P 21c16535f944455483a1738e3358e8fc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:19:17.928794 13400 tablet_replica.cc:439] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } } }
I20260809 02:19:17.928880 13400 tablet_replica.cc:442] T 28c1a20e09214ee492b7747ccb0cb290 P 8d0b6dbdc29c46bdbff3b25670ddb09f: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:19:17.929306 13382 mvcc.cc:205] Tried to move back new op lower bound from 7316447059662884864 to 7316447059618852864. Current Snapshot: MvccSnapshot[applied={T|T < 7316447059662884864}]
I20260809 02:19:17.929611 13379 tablet_replica.cc:439] T 28c1a20e09214ee492b7747ccb0cb290 P 20c686ca9e184aad80f14c3bcf577642: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d0b6dbdc29c46bdbff3b25670ddb09f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46025 } } peers { permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 } } peers { permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 } } }
I20260809 02:19:17.929689 13379 tablet_replica.cc:442] T 28c1a20e09214ee492b7747ccb0cb290 P 20c686ca9e184aad80f14c3bcf577642: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:19:17.932806 13364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.930545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40810 (local address 127.11.93.129:46025)
0809 02:19:17.930585 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:17.930587 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:17.930612 (+ 25us) server_negotiation.cc:407] Connection header received
0809 02:19:17.930686 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:17.930687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:17.930697 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:17.930748 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:19:17.930894 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.931403 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.932113 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.932316 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.932393 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.932544 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:19:17.932576 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:19:17.932644 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:17.932707 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 02:19:17.932725 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 02:19:17.937685 13364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.935441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:39395 (local address 127.11.93.129:46025)
0809 02:19:17.935497 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:17.935499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:17.935540 (+ 41us) server_negotiation.cc:407] Connection header received
0809 02:19:17.935602 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:17.935603 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:17.935611 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:17.935678 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:19:17.935828 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.936244 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.937006 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.937180 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.937261 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.937447 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:19:17.937478 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:19:17.937531 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:17.937596 (+ 65us) server_negotiation.cc:299] Negotiation successful
0809 02:19:17.937611 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 02:19:17.937749 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.935303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:46025 (local address 127.11.93.129:39395)
0809 02:19:17.935479 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:17.935491 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:17.935554 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:17.935679 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:17.935680 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:17.935681 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:19:17.935754 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.935755 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.936323 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.936324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.936911 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:17.936912 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.937262 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.937263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:17.937337 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.937357 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:19:17.937545 (+ 188us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:19:17.937547 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 02:19:17.937584 (+ 37us) client_negotiation.cc:240] Negotiation successful
0809 02:19:17.937622 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":88,"threads_started":1}
I20260809 02:19:17.940090 13297 raft_consensus.cc:1261] T 77b5db1de4ad483283c82811d64ed248 P 20c686ca9e184aad80f14c3bcf577642 [term 1 FOLLOWER]: Refusing update from remote peer 8d0b6dbdc29c46bdbff3b25670ddb09f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:17.940132 13148 raft_consensus.cc:1261] T 77b5db1de4ad483283c82811d64ed248 P 21c16535f944455483a1738e3358e8fc [term 1 FOLLOWER]: Refusing update from remote peer 8d0b6dbdc29c46bdbff3b25670ddb09f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:17.940315 13421 consensus_queue.cc:1035] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c16535f944455483a1738e3358e8fc" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 37061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:17.940443 13375 consensus_queue.cc:1035] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c686ca9e184aad80f14c3bcf577642" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:17.941704 13387 mvcc.cc:205] Tried to move back new op lower bound from 7316447059721146368 to 7316447059313414144. Current Snapshot: MvccSnapshot[applied={T|T < 7316447059721146368}]
I20260809 02:19:17.952720 12825 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48048:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:17.952838 12825 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48048:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:17.953568 12825 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b7c8e1962d6a4b578e972f41ded60f1a: Sending DeleteTablet for 3 replicas of tablet 77b5db1de4ad483283c82811d64ed248
I20260809 02:19:17.953841 12974 tablet_service.cc:1514] Processing DeleteTablet for tablet 77b5db1de4ad483283c82811d64ed248 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:17 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:40780
I20260809 02:19:17.953935 13392 tablet_replica.cc:330] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f: stopping tablet replica
I20260809 02:19:17.953927 13128 tablet_service.cc:1514] Processing DeleteTablet for tablet 77b5db1de4ad483283c82811d64ed248 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:17 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:46048
I20260809 02:19:17.953979 13392 raft_consensus.cc:2229] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:19:17.954011 13277 tablet_service.cc:1514] Processing DeleteTablet for tablet 77b5db1de4ad483283c82811d64ed248 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:17 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:36216
I20260809 02:19:17.954056 13392 raft_consensus.cc:2258] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:17.954087 13393 tablet_replica.cc:330] T 77b5db1de4ad483283c82811d64ed248 P 21c16535f944455483a1738e3358e8fc: stopping tablet replica
I20260809 02:19:17.954134 13393 raft_consensus.cc:2229] T 77b5db1de4ad483283c82811d64ed248 P 21c16535f944455483a1738e3358e8fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:17.954174 13393 raft_consensus.cc:2258] T 77b5db1de4ad483283c82811d64ed248 P 21c16535f944455483a1738e3358e8fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:17.954231 13391 tablet_replica.cc:330] T 77b5db1de4ad483283c82811d64ed248 P 20c686ca9e184aad80f14c3bcf577642: stopping tablet replica
I20260809 02:19:17.954280 13391 raft_consensus.cc:2229] T 77b5db1de4ad483283c82811d64ed248 P 20c686ca9e184aad80f14c3bcf577642 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:17.954327 13391 raft_consensus.cc:2258] T 77b5db1de4ad483283c82811d64ed248 P 20c686ca9e184aad80f14c3bcf577642 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:17.954489 13392 ts_tablet_manager.cc:1905] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:17.954583 13393 ts_tablet_manager.cc:1905] T 77b5db1de4ad483283c82811d64ed248 P 21c16535f944455483a1738e3358e8fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:17.954617 13391 ts_tablet_manager.cc:1905] T 77b5db1de4ad483283c82811d64ed248 P 20c686ca9e184aad80f14c3bcf577642: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:17.956350 13391 ts_tablet_manager.cc:1918] T 77b5db1de4ad483283c82811d64ed248 P 20c686ca9e184aad80f14c3bcf577642: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:19:17.956341 13392 ts_tablet_manager.cc:1918] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:19:17.956355 13393 ts_tablet_manager.cc:1918] T 77b5db1de4ad483283c82811d64ed248 P 21c16535f944455483a1738e3358e8fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:19:17.956406 13392 log.cc:1196] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-0/wal/wals/77b5db1de4ad483283c82811d64ed248
I20260809 02:19:17.956406 13391 log.cc:1196] T 77b5db1de4ad483283c82811d64ed248 P 20c686ca9e184aad80f14c3bcf577642: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/77b5db1de4ad483283c82811d64ed248
I20260809 02:19:17.956414 13393 log.cc:1196] T 77b5db1de4ad483283c82811d64ed248 P 21c16535f944455483a1738e3358e8fc: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/77b5db1de4ad483283c82811d64ed248
I20260809 02:19:17.956645 13392 ts_tablet_manager.cc:1939] T 77b5db1de4ad483283c82811d64ed248 P 8d0b6dbdc29c46bdbff3b25670ddb09f: Deleting consensus metadata
I20260809 02:19:17.956645 13391 ts_tablet_manager.cc:1939] T 77b5db1de4ad483283c82811d64ed248 P 20c686ca9e184aad80f14c3bcf577642: Deleting consensus metadata
I20260809 02:19:17.956650 13393 ts_tablet_manager.cc:1939] T 77b5db1de4ad483283c82811d64ed248 P 21c16535f944455483a1738e3358e8fc: Deleting consensus metadata
I20260809 02:19:17.957077 12808 catalog_manager.cc:4841] TS 21c16535f944455483a1738e3358e8fc (127.11.93.130:37061): tablet 77b5db1de4ad483283c82811d64ed248 (table test-table [id=9d8272eadae84942adab3171c37a72de]) successfully deleted
I20260809 02:19:17.957135 12811 catalog_manager.cc:4841] TS 8d0b6dbdc29c46bdbff3b25670ddb09f (127.11.93.129:46025): tablet 77b5db1de4ad483283c82811d64ed248 (table test-table [id=9d8272eadae84942adab3171c37a72de]) successfully deleted
I20260809 02:19:17.957156 12808 catalog_manager.cc:4841] TS 20c686ca9e184aad80f14c3bcf577642 (127.11.93.131:36103): tablet 77b5db1de4ad483283c82811d64ed248 (table test-table [id=9d8272eadae84942adab3171c37a72de]) successfully deleted
Aug 09 02:19:17 dist-test-slave-w206 krb5kdc[12778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241957, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.93.129@KRBTEST.COM
I20260809 02:19:17.964443 13364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.954542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40824 (local address 127.11.93.129:46025)
0809 02:19:17.954580 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:17.954582 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:17.954845 (+ 263us) server_negotiation.cc:407] Connection header received
0809 02:19:17.954957 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:17.954958 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:17.954968 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:17.955016 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:17.955820 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.956534 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.957600 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.957881 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.957943 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.961488 (+ 3545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:17.961497 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:17.961497 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:17.961505 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:17.963211 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:17.963571 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:17.963574 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:17.963575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:17.963640 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:17.963847 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:17.963848 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:17.963848 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:17.964004 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:17.964170 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:17.964214 (+ 44us) server_negotiation.cc:299] Negotiation successful
0809 02:19:17.964301 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260809 02:19:17.964780 13040 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40824
I20260809 02:19:17.971900 12879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:17.965864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48066 (local address 127.11.93.190:37369)
0809 02:19:17.965944 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:17.965947 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:17.966036 (+ 89us) server_negotiation.cc:407] Connection header received
0809 02:19:17.966109 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:17.966110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:17.966120 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:17.966175 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:17.966688 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.967265 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.967948 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:17.968152 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:17.968229 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:17.969366 (+ 1137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:17.969367 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:17.969368 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:17.969384 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:17.970688 (+ 1304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:17.971081 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:17.971082 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:17.971083 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:17.971146 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:17.971351 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:17.971352 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:17.971352 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:17.971470 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:17.971578 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:17.971711 (+ 133us) server_negotiation.cc:299] Negotiation successful
0809 02:19:17.971787 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
W20260809 02:19:17.972169 12825 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48066
I20260809 02:19:17.972851 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 12902
I20260809 02:19:17.979758 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 13055
I20260809 02:19:17.985855 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 13207
I20260809 02:19:17.992071 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 12791
2026-08-09T02:19:17Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2203 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:19:18 dist-test-slave-w206 krb5kdc[13432](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:19:18 dist-test-slave-w206 krb5kdc[13432](info): set up 2 sockets
Aug 09 02:19:18 dist-test-slave-w206 krb5kdc[13432](info): commencing operation
krb5kdc: starting...
W20260809 02:19:19.077308 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.062s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:19:19 dist-test-slave-w206 krb5kdc[13432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241959, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:19:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:19:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:19:19.203507 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:40905
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:44873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:40905
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:19.286397 13446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:19.286604 13446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:19.286628 13446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:19.287844 13446 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:19:19.287895 13446 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 02:19:19.287909 13446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:19.287950 13446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:19.287982 13446 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:19:19.287999 13446 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:19:19.289484 13446 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:44873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:40905
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:40905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:19.289736 13446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:19.290028 13446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:19.295279 13451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:19.295303 13455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:19.295311 13452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:19.295689 13446 server_base.cc:1034] running on GCE node
I20260809 02:19:19.295933 13446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:19.296217 13446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:19.297394 13446 hybrid_clock.cc:648] HybridClock initialized: now 1786241959297386 us; error 38 us; skew 500 ppm
Aug 09 02:19:19 dist-test-slave-w206 krb5kdc[13432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241959, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:19.300046 13446 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:19:19.300484 13446 webserver.cc:460] Webserver started at http://127.11.93.190:45781/ using document root <none> and password file <none>
I20260809 02:19:19.300730 13446 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:19.300799 13446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:19.300959 13446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:19.302031 13446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "c5158e2a221f4d1aa4939ee876cdcd31"
format_stamp: "Formatted at 2026-08-09 02:19:19 on dist-test-slave-w206"
server_key: "4903ad0f1558ab7bad0890278dcac470"
server_key_iv: "29cdebdc1291eab8ac4319b74a945db9"
server_key_version: "encryptionkey@0"
I20260809 02:19:19.302399 13446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "c5158e2a221f4d1aa4939ee876cdcd31"
format_stamp: "Formatted at 2026-08-09 02:19:19 on dist-test-slave-w206"
server_key: "4903ad0f1558ab7bad0890278dcac470"
server_key_iv: "29cdebdc1291eab8ac4319b74a945db9"
server_key_version: "encryptionkey@0"
I20260809 02:19:19.303802 13446 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:19:19.304536 13464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:19.304705 13446 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:19.304811 13446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "c5158e2a221f4d1aa4939ee876cdcd31"
format_stamp: "Formatted at 2026-08-09 02:19:19 on dist-test-slave-w206"
server_key: "4903ad0f1558ab7bad0890278dcac470"
server_key_iv: "29cdebdc1291eab8ac4319b74a945db9"
server_key_version: "encryptionkey@0"
I20260809 02:19:19.304883 13446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:19.325528 13446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:19.328025 13446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:19.328202 13446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:19.333060 13446 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:40905
I20260809 02:19:19.333168 13531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:40905 every 8 connection(s)
I20260809 02:19:19.333499 13446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:19:19.334213 13532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:19.336503 13532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31: Bootstrap starting.
I20260809 02:19:19.337081 13532 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:19.337311 13532 log.cc:824] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:19.337970 13532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31: No bootstrap required, opened a new log
I20260809 02:19:19.339094 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 13446
I20260809 02:19:19.339196 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:19:19.339357 11638 external_mini_cluster.cc:1428] Setting key 632987253f7281518722ba0da7e0ee5a
I20260809 02:19:19.340597 13532 raft_consensus.cc:348] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5158e2a221f4d1aa4939ee876cdcd31" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40905 } }
I20260809 02:19:19.340776 13532 raft_consensus.cc:374] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:19.340818 13532 raft_consensus.cc:729] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5158e2a221f4d1aa4939ee876cdcd31, State: Initialized, Role: FOLLOWER
I20260809 02:19:19.341014 13532 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5158e2a221f4d1aa4939ee876cdcd31" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40905 } }
I20260809 02:19:19.341104 13532 raft_consensus.cc:388] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:19:19.341127 13532 raft_consensus.cc:482] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:19:19.341187 13532 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:19.341871 13532 raft_consensus.cc:504] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5158e2a221f4d1aa4939ee876cdcd31" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40905 } }
I20260809 02:19:19.341991 13532 leader_election.cc:302] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5158e2a221f4d1aa4939ee876cdcd31; no voters:
I20260809 02:19:19.342156 13532 leader_election.cc:288] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:19:19.342219 13540 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:19.342362 13540 raft_consensus.cc:686] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31 [term 1 LEADER]: Becoming Leader. State: Replica: c5158e2a221f4d1aa4939ee876cdcd31, State: Running, Role: LEADER
I20260809 02:19:19.342396 13532 sys_catalog.cc:564] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:19:19.342509 13540 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5158e2a221f4d1aa4939ee876cdcd31" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40905 } }
I20260809 02:19:19.343130 13542 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c5158e2a221f4d1aa4939ee876cdcd31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5158e2a221f4d1aa4939ee876cdcd31" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40905 } } }
I20260809 02:19:19.343233 13542 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31 [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:19.343457 13549 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:19:19.343989 13549 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:19:19.343118 13540 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5158e2a221f4d1aa4939ee876cdcd31. Latest consensus state: current_term: 1 leader_uuid: "c5158e2a221f4d1aa4939ee876cdcd31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5158e2a221f4d1aa4939ee876cdcd31" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40905 } } }
I20260809 02:19:19.344451 13540 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31 [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:19.345707 13549 catalog_manager.cc:1347] Generated new cluster ID: a94b109ea36f49e1a5b161f3562ae78f
I20260809 02:19:19.345804 13549 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 02:19:19 dist-test-slave-w206 krb5kdc[13432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241959, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:19.351544 13539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.339959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41678 (local address 127.11.93.190:40905)
0809 02:19:19.340215 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:19.340225 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:19.340262 (+ 37us) server_negotiation.cc:407] Connection header received
0809 02:19:19.340552 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:19.340561 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:19.340625 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:19.340779 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:19.341555 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.343994 (+ 2439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.345132 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.345591 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.345733 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.348174 (+ 2441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:19.348179 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:19.348179 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:19.348191 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:19.349866 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:19.350248 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:19.350251 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:19.350251 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:19.350356 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:19.350589 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:19.350590 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:19.350590 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:19.350824 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:19.351017 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:19.351142 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 02:19:19.351398 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":105,"threads_started":1}
I20260809 02:19:19.355079 13549 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:19:19.355763 13549 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:19:19.365325 13549 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31: Generated new TSK 0
I20260809 02:19:19.365535 13549 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.93.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
I20260809 02:19:19.402159 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:40905
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:44873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:19.500870 13563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:19.501091 13563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:19.501121 13563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:19.502300 13563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:19.502344 13563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:19.502367 13563 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 02:19:19.502378 13563 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:19:19.502425 13563 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:19:19.503974 13563 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:44873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.93.190:40905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:19.504232 13563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:19.504495 13563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:19.509966 13571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:19.510069 13563 server_base.cc:1034] running on GCE node
W20260809 02:19:19.509966 13568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:19.510006 13569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:19.510406 13563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:19.510609 13563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:19.511750 13563 hybrid_clock.cc:648] HybridClock initialized: now 1786241959511730 us; error 36 us; skew 500 ppm
Aug 09 02:19:19 dist-test-slave-w206 krb5kdc[13432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241959, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:19.514442 13563 init.cc:377] Logged in from keytab as kudu/127.11.93.129@KRBTEST.COM (short username kudu)
I20260809 02:19:19.514886 13563 webserver.cc:460] Webserver started at http://127.11.93.129:38907/ using document root <none> and password file <none>
I20260809 02:19:19.515152 13563 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:19.515200 13563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:19.515354 13563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:19.516426 13563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "6170c2330cd84de48c973e297cc3bb8a"
format_stamp: "Formatted at 2026-08-09 02:19:19 on dist-test-slave-w206"
server_key: "8eb5b8ff4c1d905956e3f9683064fd04"
server_key_iv: "eefeecaffcf42836dca3e9196c16b219"
server_key_version: "encryptionkey@0"
I20260809 02:19:19.516726 13563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "6170c2330cd84de48c973e297cc3bb8a"
format_stamp: "Formatted at 2026-08-09 02:19:19 on dist-test-slave-w206"
server_key: "8eb5b8ff4c1d905956e3f9683064fd04"
server_key_iv: "eefeecaffcf42836dca3e9196c16b219"
server_key_version: "encryptionkey@0"
I20260809 02:19:19.518029 13563 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:19:19.518774 13579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:19.519093 13563 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:19.519172 13563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "6170c2330cd84de48c973e297cc3bb8a"
format_stamp: "Formatted at 2026-08-09 02:19:19 on dist-test-slave-w206"
server_key: "8eb5b8ff4c1d905956e3f9683064fd04"
server_key_iv: "eefeecaffcf42836dca3e9196c16b219"
server_key_version: "encryptionkey@0"
I20260809 02:19:19.519223 13563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:19.529342 13563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:19.531782 13563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:19.531957 13563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:19.532559 13563 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:19.532599 13563 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:19.532622 13563 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:19.532635 13563 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:19:19 dist-test-slave-w206 krb5kdc[13432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241959, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:19.540328 13563 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:43721
I20260809 02:19:19.540472 13703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:43721 every 8 connection(s)
I20260809 02:19:19.540769 13563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:19:19.543493 13539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.533037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:47439 (local address 127.11.93.190:40905)
0809 02:19:19.533113 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:19.533116 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:19.533373 (+ 257us) server_negotiation.cc:407] Connection header received
0809 02:19:19.534124 (+ 751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:19.534125 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:19.534139 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:19.534234 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:19.535216 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.535761 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.537431 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.537653 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.537742 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.540415 (+ 2673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:19.540417 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:19.540417 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:19.540424 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:19.541975 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:19.542332 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:19.542332 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:19.542333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:19.542432 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:19.542779 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:19.542781 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:19.542781 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:19.542921 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:19.543074 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:19.543347 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 02:19:19.543425 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:19:19.543731 13588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.533014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40905 (local address 127.11.93.129:47439)
0809 02:19:19.533219 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:19.533273 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:19.534011 (+ 738us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:19.534319 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:19.534325 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:19.534738 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:19.535089 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.535096 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.535858 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.535859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.537320 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.537323 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.537765 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.537766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.537937 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.538497 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:19.538508 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:19.540294 (+ 1786us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:19.542043 (+ 1749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:19.542048 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:19.542050 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:19.542265 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:19.542514 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:19.542515 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:19.542515 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:19.542628 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:19.543061 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:19.543068 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:19.543215 (+ 147us) client_negotiation.cc:769] Sending connection context
0809 02:19:19.543326 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 02:19:19.543457 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":102,"threads_started":1}
I20260809 02:19:19.544341 13704 heartbeater.cc:347] Connected to a master server at 127.11.93.190:40905
I20260809 02:19:19.544420 13704 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:19.544600 13704 heartbeater.cc:511] Master 127.11.93.190:40905 requested a full tablet report, sending...
I20260809 02:19:19.545122 13482 ts_manager.cc:194] Registered new tserver with Master: 6170c2330cd84de48c973e297cc3bb8a (127.11.93.129:43721)
I20260809 02:19:19.545850 13482 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:47439
I20260809 02:19:19.548226 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 13563
I20260809 02:19:19.548352 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:19:19.548544 11638 external_mini_cluster.cc:1428] Setting key a49f92d56637ba737cc9d3421a4ed72e
I20260809 02:19:19.551476 13539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.545589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:50999 (local address 127.11.93.190:40905)
0809 02:19:19.545633 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:19.545634 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:19.545777 (+ 143us) server_negotiation.cc:407] Connection header received
0809 02:19:19.545827 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:19.545828 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:19.545836 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:19.545881 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:19.546251 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.546704 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.547464 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.547658 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.547729 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.548642 (+ 913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:19.548643 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:19.548643 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:19.548650 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:19.550333 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:19.550648 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:19.550649 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:19.550650 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:19.550717 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:19.550900 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:19.550901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:19.550902 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:19.551076 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:19.551144 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:19.551250 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 02:19:19.551345 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 02:19:19.551503 13710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.545537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40905 (local address 127.11.93.129:50999)
0809 02:19:19.545698 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:19.545710 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:19.545772 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:19.545912 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:19.545912 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:19.546103 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:19.546162 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.546164 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.546798 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.546799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.547363 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.547365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.547727 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.547728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.547797 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.548206 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:19.548211 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:19.548558 (+ 347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:19.550410 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:19.550411 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:19.550411 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:19.550570 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:19.550785 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:19.550785 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:19.550786 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:19.550836 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:19.551138 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:19.551139 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:19.551173 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 02:19:19.551221 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 02:19:19.551350 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":89,"threads_started":1}
WARNING: no policy specified for kudu/127.11.93.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
I20260809 02:19:19.574195 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:40905
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:44873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:19.657490 13713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:19.657681 13713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:19.657706 13713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:19.658798 13713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:19.658833 13713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:19.658854 13713 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 02:19:19.658865 13713 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:19:19.658881 13713 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:19:19.660398 13713 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:44873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.93.190:40905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:19.660578 13713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:19.660743 13713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:19:19.665726 13713 server_base.cc:1034] running on GCE node
W20260809 02:19:19.665688 13719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:19.665817 13721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:19.665694 13718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:19.666193 13713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:19.666448 13713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:19.667619 13713 hybrid_clock.cc:648] HybridClock initialized: now 1786241959667608 us; error 30 us; skew 500 ppm
Aug 09 02:19:19 dist-test-slave-w206 krb5kdc[13432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241959, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:19.670138 13713 init.cc:377] Logged in from keytab as kudu/127.11.93.130@KRBTEST.COM (short username kudu)
I20260809 02:19:19.670526 13713 webserver.cc:460] Webserver started at http://127.11.93.130:45039/ using document root <none> and password file <none>
I20260809 02:19:19.670722 13713 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:19.670761 13713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:19.670850 13713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:19.672166 13713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "ef007ba8d18143b4983755af4d2b59c6"
format_stamp: "Formatted at 2026-08-09 02:19:19 on dist-test-slave-w206"
server_key: "2ffaf5ac816cc1f58a47d8ee086edf99"
server_key_iv: "f861ff6708dbb74df9576f5d38a7040c"
server_key_version: "encryptionkey@0"
I20260809 02:19:19.672468 13713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "ef007ba8d18143b4983755af4d2b59c6"
format_stamp: "Formatted at 2026-08-09 02:19:19 on dist-test-slave-w206"
server_key: "2ffaf5ac816cc1f58a47d8ee086edf99"
server_key_iv: "f861ff6708dbb74df9576f5d38a7040c"
server_key_version: "encryptionkey@0"
I20260809 02:19:19.673731 13713 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:19:19.674427 13728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:19.674612 13713 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:19:19.674688 13713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "ef007ba8d18143b4983755af4d2b59c6"
format_stamp: "Formatted at 2026-08-09 02:19:19 on dist-test-slave-w206"
server_key: "2ffaf5ac816cc1f58a47d8ee086edf99"
server_key_iv: "f861ff6708dbb74df9576f5d38a7040c"
server_key_version: "encryptionkey@0"
I20260809 02:19:19.674741 13713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:19.696328 13713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:19.698580 13713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:19.698691 13713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:19.699184 13713 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:19.699223 13713 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:19.699249 13713 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:19.699302 13713 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:19.706748 13713 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:33799
I20260809 02:19:19.706844 13850 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:33799 every 8 connection(s)
Aug 09 02:19:19 dist-test-slave-w206 krb5kdc[13432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241959, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:19.707209 13713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:19:19.709806 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 13713
I20260809 02:19:19.709920 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:19:19.710166 11638 external_mini_cluster.cc:1428] Setting key 05d0df86ab46ebdfa06df2c42244f5b3
I20260809 02:19:19.710660 13539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.699704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:39211 (local address 127.11.93.190:40905)
0809 02:19:19.699780 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:19.699783 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:19.700068 (+ 285us) server_negotiation.cc:407] Connection header received
0809 02:19:19.700808 (+ 740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:19.700809 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:19.700819 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:19.700872 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:19.701800 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.702638 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.704363 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.704686 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.704758 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.707704 (+ 2946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:19.707705 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:19.707706 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:19.707715 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:19.709148 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:19.709556 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:19.709557 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:19.709558 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:19.709635 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:19.709895 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:19.709897 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:19.709897 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:19.710066 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:19.710146 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:19.710474 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 02:19:19.710567 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:19:19.710847 13737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.699675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40905 (local address 127.11.93.130:39211)
0809 02:19:19.699897 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:19.699959 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:19.700688 (+ 729us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:19.700956 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:19.700961 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:19.701372 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:19.701683 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.701690 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.702741 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.702742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.704250 (+ 1508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.704254 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.704778 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.704779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.704951 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.705580 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:19.705591 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:19.707600 (+ 2009us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:19.709242 (+ 1642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:19.709248 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:19.709250 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:19.709478 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:19.709711 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:19.709711 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:19.709712 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:19.709810 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:19.710143 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:19.710149 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:19.710294 (+ 145us) client_negotiation.cc:769] Sending connection context
0809 02:19:19.710441 (+ 147us) client_negotiation.cc:240] Negotiation successful
0809 02:19:19.710602 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":100,"threads_started":1}
I20260809 02:19:19.711366 13851 heartbeater.cc:347] Connected to a master server at 127.11.93.190:40905
I20260809 02:19:19.711462 13851 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:19.711660 13851 heartbeater.cc:511] Master 127.11.93.190:40905 requested a full tablet report, sending...
I20260809 02:19:19.712322 13482 ts_manager.cc:194] Registered new tserver with Master: ef007ba8d18143b4983755af4d2b59c6 (127.11.93.130:33799)
I20260809 02:19:19.712852 13482 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:39211
I20260809 02:19:19.719105 13539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.712438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:60277 (local address 127.11.93.190:40905)
0809 02:19:19.712483 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:19.712485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:19.712701 (+ 216us) server_negotiation.cc:407] Connection header received
0809 02:19:19.712786 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:19.712787 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:19.712796 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:19.712824 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:19.713329 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.714106 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.715165 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.715356 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.715425 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.716499 (+ 1074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:19.716501 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:19.716501 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:19.716507 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:19.717912 (+ 1405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:19.718309 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:19.718309 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:19.718310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:19.718360 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:19.718571 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:19.718572 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:19.718572 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:19.718706 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:19.718758 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:19.718928 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 02:19:19.719044 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 02:19:19.719502 13858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.712484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40905 (local address 127.11.93.130:60277)
0809 02:19:19.712636 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:19.712647 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:19.712725 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:19.712892 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:19.712893 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:19.713149 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:19.713238 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.713240 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.714206 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.714207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.715083 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.715086 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.715441 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.715442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.715533 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.715995 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:19.716001 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:19.716412 (+ 411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:19.717996 (+ 1584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:19.717997 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:19.717998 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:19.718231 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:19.718431 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:19.718432 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:19.718433 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:19.718506 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:19.718775 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:19.718776 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:19.718827 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 02:19:19.718913 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 02:19:19.719047 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":82,"threads_started":1}
WARNING: no policy specified for kudu/127.11.93.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
I20260809 02:19:19.738574 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:40905
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:44873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:19.820557 13861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:19.820763 13861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:19.820789 13861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:19.821940 13861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:19.821985 13861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:19.822005 13861 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 02:19:19.822016 13861 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:19:19.822067 13861 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:19:19.823567 13861 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:44873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.93.190:40905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13861
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:19.823750 13861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:19.823925 13861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:19.828992 13867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:19.828986 13869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:19.829137 13866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:19.829447 13861 server_base.cc:1034] running on GCE node
I20260809 02:19:19.829660 13861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:19.829900 13861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:19.831064 13861 hybrid_clock.cc:648] HybridClock initialized: now 1786241959831035 us; error 35 us; skew 500 ppm
Aug 09 02:19:19 dist-test-slave-w206 krb5kdc[13432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241959, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:19.833570 13861 init.cc:377] Logged in from keytab as kudu/127.11.93.131@KRBTEST.COM (short username kudu)
I20260809 02:19:19.834049 13861 webserver.cc:460] Webserver started at http://127.11.93.131:43489/ using document root <none> and password file <none>
I20260809 02:19:19.834295 13861 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:19.834365 13861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:19.834520 13861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:19.835619 13861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "954e3557e1b74bfb9040a2979f6242ea"
format_stamp: "Formatted at 2026-08-09 02:19:19 on dist-test-slave-w206"
server_key: "6b6167799c9ff058d354d4076e8c4644"
server_key_iv: "226f352ff52771c86397d30d16ac17ea"
server_key_version: "encryptionkey@0"
I20260809 02:19:19.835992 13861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "954e3557e1b74bfb9040a2979f6242ea"
format_stamp: "Formatted at 2026-08-09 02:19:19 on dist-test-slave-w206"
server_key: "6b6167799c9ff058d354d4076e8c4644"
server_key_iv: "226f352ff52771c86397d30d16ac17ea"
server_key_version: "encryptionkey@0"
I20260809 02:19:19.837332 13861 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:19:19.838091 13876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:19.838258 13861 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:19:19.838358 13861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "954e3557e1b74bfb9040a2979f6242ea"
format_stamp: "Formatted at 2026-08-09 02:19:19 on dist-test-slave-w206"
server_key: "6b6167799c9ff058d354d4076e8c4644"
server_key_iv: "226f352ff52771c86397d30d16ac17ea"
server_key_version: "encryptionkey@0"
I20260809 02:19:19.838442 13861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:19.850739 13861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:19.853247 13861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:19.853420 13861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:19.853991 13861 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:19.854050 13861 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:19.854089 13861 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:19.854112 13861 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:19:19 dist-test-slave-w206 krb5kdc[13432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241959, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:19.861445 13861 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:32957
I20260809 02:19:19.861497 14002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:32957 every 8 connection(s)
I20260809 02:19:19.861872 13861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:19:19.863705 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 13861
I20260809 02:19:19.863797 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:19:19.863979 11638 external_mini_cluster.cc:1428] Setting key 414b4d53b6b5da72f97efe2d44a66c6e
I20260809 02:19:19.864835 13539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.854416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:60185 (local address 127.11.93.190:40905)
0809 02:19:19.854483 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:19.854486 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:19.854722 (+ 236us) server_negotiation.cc:407] Connection header received
0809 02:19:19.855273 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:19.855274 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:19.855290 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:19.855386 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:19.856003 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.856844 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.857863 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.858208 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.858285 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.861051 (+ 2766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:19.861053 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:19.861053 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:19.861063 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:19.863123 (+ 2060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:19.863595 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:19.863596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:19.863596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:19.863677 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:19.863995 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:19.863996 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:19.863996 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:19.864164 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:19.864244 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:19.864633 (+ 389us) server_negotiation.cc:299] Negotiation successful
0809 02:19:19.864737 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:19:19.864964 13886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.854411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40905 (local address 127.11.93.131:60185)
0809 02:19:19.854587 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:19.854627 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:19.855174 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:19.855468 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:19.855475 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:19.855712 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:19.855887 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.855891 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.856954 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.856955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.857758 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.857760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.858303 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.858304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.858455 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.859103 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:19.859111 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:19.860956 (+ 1845us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:19.863234 (+ 2278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:19.863241 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:19.863243 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:19.863490 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:19.863754 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:19.863755 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:19.863756 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:19.863901 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:19.864262 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:19.864270 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:19.864430 (+ 160us) client_negotiation.cc:769] Sending connection context
0809 02:19:19.864569 (+ 139us) client_negotiation.cc:240] Negotiation successful
0809 02:19:19.864747 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":108,"threads_started":1}
I20260809 02:19:19.865690 14003 heartbeater.cc:347] Connected to a master server at 127.11.93.190:40905
I20260809 02:19:19.865792 14003 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:19.865975 14003 heartbeater.cc:511] Master 127.11.93.190:40905 requested a full tablet report, sending...
I20260809 02:19:19.866367 13484 ts_manager.cc:194] Registered new tserver with Master: 954e3557e1b74bfb9040a2979f6242ea (127.11.93.131:32957)
I20260809 02:19:19.866865 13484 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:60185
I20260809 02:19:19.872159 13539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.866878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:56925 (local address 127.11.93.190:40905)
0809 02:19:19.866926 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:19.866929 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:19.867024 (+ 95us) server_negotiation.cc:407] Connection header received
0809 02:19:19.867106 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:19.867107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:19.867120 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:19.867170 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:19.867581 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.868015 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.868782 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.868953 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.869002 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.869854 (+ 852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:19.869855 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:19.869856 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:19.869861 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:19.871280 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:19.871600 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:19.871601 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:19.871601 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:19.871650 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:19.871807 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:19.871808 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:19.871808 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:19.871894 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:19.871940 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:19.872048 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 02:19:19.872102 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 02:19:19.872176 14010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.866793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40905 (local address 127.11.93.131:56925)
0809 02:19:19.866938 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:19.866950 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:19.867040 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:19.867197 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:19.867198 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:19.867413 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:19.867498 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.867500 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.868115 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.868116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.868708 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.868710 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.869022 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.869022 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.869086 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.869475 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:19.869480 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:19.869773 (+ 293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:19.871352 (+ 1579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:19.871353 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:19.871353 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:19.871535 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:19.871707 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:19.871708 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:19.871708 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:19.871761 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:19.871947 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:19.871948 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:19.871983 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 02:19:19.872034 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 02:19:19.872108 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":88,"threads_started":1}
I20260809 02:19:19.875628 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 02:19:19 dist-test-slave-w206 krb5kdc[13432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241959, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 02:19:19 dist-test-slave-w206 krb5kdc[13432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241959, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:19.899277 13539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.892782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41694 (local address 127.11.93.190:40905)
0809 02:19:19.892845 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:19.892847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:19.892856 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:19:19.892883 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:19.892884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:19.892893 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:19.892942 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:19.893467 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.893946 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.894634 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.894807 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.894857 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.897181 (+ 2324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:19.897182 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:19.897182 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:19.897187 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:19.898319 (+ 1132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:19.898615 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:19.898615 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:19.898616 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:19.898664 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:19.898829 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:19.898830 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:19.898830 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:19.898931 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:19.899058 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:19.899155 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 02:19:19.899213 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 02:19:19.900935 13484 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41694:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:19:19.902585 13484 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:19:19.909363 14022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.905021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:43721 (local address 127.0.0.1:49658)
0809 02:19:19.905185 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:19.905223 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:19.905285 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:19.905747 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:19.905758 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:19.905760 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:19.905853 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.905855 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.906878 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.906879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.908161 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.908164 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.909038 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.909039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.909128 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.909143 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 02:19:19.909224 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 02:19:19.909277 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":51,"threads_started":1}
I20260809 02:19:19.909406 14024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.905117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49658 (local address 127.11.93.129:43721)
0809 02:19:19.905485 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:19.905488 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:19.905517 (+ 29us) server_negotiation.cc:407] Connection header received
0809 02:19:19.905558 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:19.905560 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:19.905578 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:19.905667 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:19.905940 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.906789 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.908249 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.908952 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.909028 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.909084 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:19.909251 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 02:19:19.909293 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":89,"threads_started":1}
I20260809 02:19:19.909727 14021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.905034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:32957 (local address 127.0.0.1:37258)
0809 02:19:19.905576 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:19.905584 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:19.905623 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:19.906026 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:19.906027 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:19.906028 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:19.906064 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.906066 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.907297 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.907298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.908551 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.908552 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.909471 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.909472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.909550 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.909553 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:19:19.909604 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 02:19:19.909641 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"mutex_wait_us":61,"thread_start_us":82,"threads_started":1}
I20260809 02:19:19.909938 14023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.905022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:33799 (local address 127.0.0.1:57824)
0809 02:19:19.905442 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:19.905452 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:19.905512 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:19.905769 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:19.905770 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:19.905772 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:19.905868 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.905935 (+ 67us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.907296 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.907298 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.908549 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.908552 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.909650 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.909652 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.909718 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.909722 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:19:19.909768 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 02:19:19.909830 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":402,"mutex_wait_us":100,"thread_start_us":90,"threads_started":1}
I20260809 02:19:19.909971 14025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.905254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37258 (local address 127.11.93.131:32957)
0809 02:19:19.905549 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:19.905553 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:19.905621 (+ 68us) server_negotiation.cc:407] Connection header received
0809 02:19:19.905847 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:19.905850 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:19.905866 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:19.905954 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:19.906142 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.907195 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.908649 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.909318 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.909380 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.909432 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:19.909826 (+ 394us) server_negotiation.cc:299] Negotiation successful
0809 02:19:19.909869 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":94,"threads_started":1}
I20260809 02:19:19.910249 13635 tablet_service.cc:1467] Processing CreateTablet for tablet 95c3b8b70e844cc895d7e3dfb9d13626 (DEFAULT_TABLE table=test-table [id=b4b14364724148339e10983e18041a70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:19.910480 14026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.905264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57824 (local address 127.11.93.130:33799)
0809 02:19:19.905458 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:19.905466 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:19.905525 (+ 59us) server_negotiation.cc:407] Connection header received
0809 02:19:19.905582 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:19.905584 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:19.905598 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:19.905669 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:19.906016 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.907203 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.908638 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.909374 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.910285 (+ 911us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.910353 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:19.910375 (+ 22us) server_negotiation.cc:299] Negotiation successful
0809 02:19:19.910409 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":87,"threads_started":1}
I20260809 02:19:19.910631 13635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95c3b8b70e844cc895d7e3dfb9d13626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:19.910586 13934 tablet_service.cc:1467] Processing CreateTablet for tablet 95c3b8b70e844cc895d7e3dfb9d13626 (DEFAULT_TABLE table=test-table [id=b4b14364724148339e10983e18041a70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:19.910931 13934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95c3b8b70e844cc895d7e3dfb9d13626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:19.911074 13783 tablet_service.cc:1467] Processing CreateTablet for tablet 95c3b8b70e844cc895d7e3dfb9d13626 (DEFAULT_TABLE table=test-table [id=b4b14364724148339e10983e18041a70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:19.911397 13783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95c3b8b70e844cc895d7e3dfb9d13626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:19.914065 14027 tablet_bootstrap.cc:492] T 95c3b8b70e844cc895d7e3dfb9d13626 P 954e3557e1b74bfb9040a2979f6242ea: Bootstrap starting.
I20260809 02:19:19.914496 14028 tablet_bootstrap.cc:492] T 95c3b8b70e844cc895d7e3dfb9d13626 P ef007ba8d18143b4983755af4d2b59c6: Bootstrap starting.
I20260809 02:19:19.914857 14029 tablet_bootstrap.cc:492] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a: Bootstrap starting.
I20260809 02:19:19.915040 14027 tablet_bootstrap.cc:654] T 95c3b8b70e844cc895d7e3dfb9d13626 P 954e3557e1b74bfb9040a2979f6242ea: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:19.915119 14028 tablet_bootstrap.cc:654] T 95c3b8b70e844cc895d7e3dfb9d13626 P ef007ba8d18143b4983755af4d2b59c6: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:19.915427 14027 log.cc:824] T 95c3b8b70e844cc895d7e3dfb9d13626 P 954e3557e1b74bfb9040a2979f6242ea: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:19.915470 14028 log.cc:824] T 95c3b8b70e844cc895d7e3dfb9d13626 P ef007ba8d18143b4983755af4d2b59c6: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:19.915544 14029 tablet_bootstrap.cc:654] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:19.915908 14029 log.cc:824] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:19.916311 14028 tablet_bootstrap.cc:492] T 95c3b8b70e844cc895d7e3dfb9d13626 P ef007ba8d18143b4983755af4d2b59c6: No bootstrap required, opened a new log
I20260809 02:19:19.916386 14028 ts_tablet_manager.cc:1397] T 95c3b8b70e844cc895d7e3dfb9d13626 P ef007ba8d18143b4983755af4d2b59c6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:19:19.916440 14027 tablet_bootstrap.cc:492] T 95c3b8b70e844cc895d7e3dfb9d13626 P 954e3557e1b74bfb9040a2979f6242ea: No bootstrap required, opened a new log
I20260809 02:19:19.916518 14027 ts_tablet_manager.cc:1397] T 95c3b8b70e844cc895d7e3dfb9d13626 P 954e3557e1b74bfb9040a2979f6242ea: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260809 02:19:19.916991 14029 tablet_bootstrap.cc:492] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a: No bootstrap required, opened a new log
I20260809 02:19:19.917105 14029 ts_tablet_manager.cc:1397] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260809 02:19:19.917812 14028 raft_consensus.cc:348] T 95c3b8b70e844cc895d7e3dfb9d13626 P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:19.917955 14028 raft_consensus.cc:374] T 95c3b8b70e844cc895d7e3dfb9d13626 P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:19.917979 14028 raft_consensus.cc:729] T 95c3b8b70e844cc895d7e3dfb9d13626 P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef007ba8d18143b4983755af4d2b59c6, State: Initialized, Role: FOLLOWER
I20260809 02:19:19.918098 14028 consensus_queue.cc:260] T 95c3b8b70e844cc895d7e3dfb9d13626 P ef007ba8d18143b4983755af4d2b59c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:19.918383 13851 heartbeater.cc:503] Master 127.11.93.190:40905 was elected leader, sending a full tablet report...
I20260809 02:19:19.918370 14028 ts_tablet_manager.cc:1428] T 95c3b8b70e844cc895d7e3dfb9d13626 P ef007ba8d18143b4983755af4d2b59c6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:19:19.918550 14027 raft_consensus.cc:348] T 95c3b8b70e844cc895d7e3dfb9d13626 P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:19.918710 14027 raft_consensus.cc:374] T 95c3b8b70e844cc895d7e3dfb9d13626 P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:19.918754 14027 raft_consensus.cc:729] T 95c3b8b70e844cc895d7e3dfb9d13626 P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 954e3557e1b74bfb9040a2979f6242ea, State: Initialized, Role: FOLLOWER
I20260809 02:19:19.918898 14027 consensus_queue.cc:260] T 95c3b8b70e844cc895d7e3dfb9d13626 P 954e3557e1b74bfb9040a2979f6242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:19.919195 14027 ts_tablet_manager.cc:1428] T 95c3b8b70e844cc895d7e3dfb9d13626 P 954e3557e1b74bfb9040a2979f6242ea: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 02:19:19.919226 14003 heartbeater.cc:503] Master 127.11.93.190:40905 was elected leader, sending a full tablet report...
I20260809 02:19:19.919557 14029 raft_consensus.cc:348] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:19.919711 14029 raft_consensus.cc:374] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:19.919791 14029 raft_consensus.cc:729] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6170c2330cd84de48c973e297cc3bb8a, State: Initialized, Role: FOLLOWER
I20260809 02:19:19.919927 14029 consensus_queue.cc:260] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:19.920217 14029 ts_tablet_manager.cc:1428] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260809 02:19:19.920272 13704 heartbeater.cc:503] Master 127.11.93.190:40905 was elected leader, sending a full tablet report...
I20260809 02:19:19.926331 14036 raft_consensus.cc:482] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:19:19.926414 14036 raft_consensus.cc:504] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:19.926741 14036 leader_election.cc:288] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef007ba8d18143b4983755af4d2b59c6 (127.11.93.130:33799), 954e3557e1b74bfb9040a2979f6242ea (127.11.93.131:32957)
I20260809 02:19:19.929566 14037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.926908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:33799 (local address 127.11.93.129:49325)
0809 02:19:19.927134 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:19.927144 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:19.927213 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:19.927360 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:19.927360 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:19.927362 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:19.927432 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.927434 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.928058 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.928059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.928790 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.928791 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.929313 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.929315 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.929396 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.929401 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:19:19.929451 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 02:19:19.929478 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"mutex_wait_us":41,"thread_start_us":117,"threads_started":1}
I20260809 02:19:19.929589 14026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.926968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:49325 (local address 127.11.93.130:33799)
0809 02:19:19.927028 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:19.927030 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:19.927210 (+ 180us) server_negotiation.cc:407] Connection header received
0809 02:19:19.927268 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:19.927269 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:19.927279 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:19.927343 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:19.927496 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.927965 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.928891 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.929233 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.929290 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.929296 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:19.929475 (+ 179us) server_negotiation.cc:299] Negotiation successful
0809 02:19:19.929520 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 02:19:19.929708 14025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.926968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:43157 (local address 127.11.93.131:32957)
0809 02:19:19.927072 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:19.927073 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:19.927081 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:19:19.927109 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:19.927110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:19.927120 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:19.927192 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:19.927366 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.927900 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.928884 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.929256 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.929348 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.929356 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:19.929578 (+ 222us) server_negotiation.cc:299] Negotiation successful
0809 02:19:19.929624 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 02:19:19.929668 13588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.926908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:32957 (local address 127.11.93.129:43157)
0809 02:19:19.926989 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:19.927011 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:19.927055 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:19.927220 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:19.927221 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:19.927222 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:19.927293 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.927295 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.927989 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.927990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.928787 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.928789 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.929367 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.929368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.929493 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.929497 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:19:19.929556 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 02:19:19.929594 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":36}
I20260809 02:19:19.930025 13803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c3b8b70e844cc895d7e3dfb9d13626" candidate_uuid: "6170c2330cd84de48c973e297cc3bb8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef007ba8d18143b4983755af4d2b59c6" is_pre_election: true
I20260809 02:19:19.930043 13954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c3b8b70e844cc895d7e3dfb9d13626" candidate_uuid: "6170c2330cd84de48c973e297cc3bb8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "954e3557e1b74bfb9040a2979f6242ea" is_pre_election: true
I20260809 02:19:19.930163 13803 raft_consensus.cc:2454] T 95c3b8b70e844cc895d7e3dfb9d13626 P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6170c2330cd84de48c973e297cc3bb8a in term 0.
I20260809 02:19:19.930179 13954 raft_consensus.cc:2454] T 95c3b8b70e844cc895d7e3dfb9d13626 P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6170c2330cd84de48c973e297cc3bb8a in term 0.
I20260809 02:19:19.930363 13583 leader_election.cc:302] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6170c2330cd84de48c973e297cc3bb8a, ef007ba8d18143b4983755af4d2b59c6; no voters:
I20260809 02:19:19.930542 14036 raft_consensus.cc:2781] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:19:19.930620 14036 raft_consensus.cc:482] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:19:19.930656 14036 raft_consensus.cc:3037] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:19.931424 14036 raft_consensus.cc:504] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:19.931569 14036 leader_election.cc:288] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a [CANDIDATE]: Term 1 election: Requested vote from peers ef007ba8d18143b4983755af4d2b59c6 (127.11.93.130:33799), 954e3557e1b74bfb9040a2979f6242ea (127.11.93.131:32957)
I20260809 02:19:19.931713 13803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c3b8b70e844cc895d7e3dfb9d13626" candidate_uuid: "6170c2330cd84de48c973e297cc3bb8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef007ba8d18143b4983755af4d2b59c6"
I20260809 02:19:19.931728 13954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95c3b8b70e844cc895d7e3dfb9d13626" candidate_uuid: "6170c2330cd84de48c973e297cc3bb8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "954e3557e1b74bfb9040a2979f6242ea"
I20260809 02:19:19.931807 13954 raft_consensus.cc:3037] T 95c3b8b70e844cc895d7e3dfb9d13626 P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:19.931813 13803 raft_consensus.cc:3037] T 95c3b8b70e844cc895d7e3dfb9d13626 P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:19.932551 13954 raft_consensus.cc:2454] T 95c3b8b70e844cc895d7e3dfb9d13626 P 954e3557e1b74bfb9040a2979f6242ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6170c2330cd84de48c973e297cc3bb8a in term 1.
I20260809 02:19:19.932687 13803 raft_consensus.cc:2454] T 95c3b8b70e844cc895d7e3dfb9d13626 P ef007ba8d18143b4983755af4d2b59c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6170c2330cd84de48c973e297cc3bb8a in term 1.
I20260809 02:19:19.933108 13581 leader_election.cc:302] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6170c2330cd84de48c973e297cc3bb8a, 954e3557e1b74bfb9040a2979f6242ea; no voters:
I20260809 02:19:19.933238 14036 raft_consensus.cc:2781] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:19.933357 14036 raft_consensus.cc:686] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a [term 1 LEADER]: Becoming Leader. State: Replica: 6170c2330cd84de48c973e297cc3bb8a, State: Running, Role: LEADER
I20260809 02:19:19.933459 14036 consensus_queue.cc:237] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:19.934218 13482 catalog_manager.cc:5495] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6170c2330cd84de48c973e297cc3bb8a (127.11.93.129). New cstate: current_term: 1 leader_uuid: "6170c2330cd84de48c973e297cc3bb8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } health_report { overall_health: UNKNOWN } } }
W20260809 02:19:19.957881 13853 tablet.cc:2369] T 95c3b8b70e844cc895d7e3dfb9d13626 P ef007ba8d18143b4983755af4d2b59c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 02:19:19 dist-test-slave-w206 krb5kdc[13432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241959, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:19.962168 14046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.955735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40905 (local address 127.0.0.1:41702)
0809 02:19:19.955874 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:19.955884 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:19.955963 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:19.956086 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:19.956087 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:19.956381 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:19.956430 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.956432 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.957042 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.957043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.957560 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:19.957561 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.957868 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.957870 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:19.957947 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.958458 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:19.958462 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:19.959868 (+ 1406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:19.961242 (+ 1374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:19.961249 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:19.961251 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:19.961453 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:19.961628 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:19.961628 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:19.961629 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:19.961684 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:19.961886 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:19.961893 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:19.961934 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 02:19:19.961985 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 02:19:19.962076 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":70,"threads_started":1}
I20260809 02:19:19.962217 13539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:19.955810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41702 (local address 127.11.93.190:40905)
0809 02:19:19.955903 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:19.955906 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:19.955963 (+ 57us) server_negotiation.cc:407] Connection header received
0809 02:19:19.956004 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:19.956005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:19.956013 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:19.956064 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:19.956494 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.956969 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.957625 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:19.957796 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:19.957844 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:19.959964 (+ 2120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:19.959966 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:19.959966 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:19.959972 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:19.961167 (+ 1195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:19.961518 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:19.961519 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:19.961520 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:19.961569 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:19.961735 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:19.961736 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:19.961736 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:19.961834 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:19.961893 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:19.962017 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 02:19:19.962124 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":46}
I20260809 02:19:19.964123 13482 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:41702:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 02:19:19.964301 13482 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:19:19.965837 13635 tablet_service.cc:1467] Processing CreateTablet for tablet 36226b46f901417a9d10dca118fb44fb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d2b75b6b602d4311b03fbdaf393e5b50]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:19:19.965845 13934 tablet_service.cc:1467] Processing CreateTablet for tablet 36226b46f901417a9d10dca118fb44fb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d2b75b6b602d4311b03fbdaf393e5b50]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:19:19.966018 13934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36226b46f901417a9d10dca118fb44fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:19.966018 13635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36226b46f901417a9d10dca118fb44fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:19.967655 14027 tablet_bootstrap.cc:492] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea: Bootstrap starting.
I20260809 02:19:19.967655 14029 tablet_bootstrap.cc:492] T 36226b46f901417a9d10dca118fb44fb P 6170c2330cd84de48c973e297cc3bb8a: Bootstrap starting.
I20260809 02:19:19.967778 13783 tablet_service.cc:1467] Processing CreateTablet for tablet 36226b46f901417a9d10dca118fb44fb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d2b75b6b602d4311b03fbdaf393e5b50]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:19:19.967926 13783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36226b46f901417a9d10dca118fb44fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:19.968168 14029 tablet_bootstrap.cc:654] T 36226b46f901417a9d10dca118fb44fb P 6170c2330cd84de48c973e297cc3bb8a: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:19.968256 14027 tablet_bootstrap.cc:654] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:19.968956 14029 tablet_bootstrap.cc:492] T 36226b46f901417a9d10dca118fb44fb P 6170c2330cd84de48c973e297cc3bb8a: No bootstrap required, opened a new log
I20260809 02:19:19.968987 14027 tablet_bootstrap.cc:492] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea: No bootstrap required, opened a new log
I20260809 02:19:19.969023 14029 ts_tablet_manager.cc:1397] T 36226b46f901417a9d10dca118fb44fb P 6170c2330cd84de48c973e297cc3bb8a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260809 02:19:19.969033 14027 ts_tablet_manager.cc:1397] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 02:19:19.969223 14028 tablet_bootstrap.cc:492] T 36226b46f901417a9d10dca118fb44fb P ef007ba8d18143b4983755af4d2b59c6: Bootstrap starting.
I20260809 02:19:19.969180 14027 raft_consensus.cc:348] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:19.969179 14029 raft_consensus.cc:348] T 36226b46f901417a9d10dca118fb44fb P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:19.969266 14027 raft_consensus.cc:374] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:19.969273 14029 raft_consensus.cc:374] T 36226b46f901417a9d10dca118fb44fb P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:19.969291 14027 raft_consensus.cc:729] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 954e3557e1b74bfb9040a2979f6242ea, State: Initialized, Role: FOLLOWER
I20260809 02:19:19.969295 14029 raft_consensus.cc:729] T 36226b46f901417a9d10dca118fb44fb P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6170c2330cd84de48c973e297cc3bb8a, State: Initialized, Role: FOLLOWER
I20260809 02:19:19.969338 14029 consensus_queue.cc:260] T 36226b46f901417a9d10dca118fb44fb P 6170c2330cd84de48c973e297cc3bb8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:19.969338 14027 consensus_queue.cc:260] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:19.969437 14027 ts_tablet_manager.cc:1428] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:19.969453 14029 ts_tablet_manager.cc:1428] T 36226b46f901417a9d10dca118fb44fb P 6170c2330cd84de48c973e297cc3bb8a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:19.969498 14035 tablet_replica.cc:439] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } } }
I20260809 02:19:19.969588 14035 tablet_replica.cc:442] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:19:19.969600 14036 tablet_replica.cc:439] T 36226b46f901417a9d10dca118fb44fb P 6170c2330cd84de48c973e297cc3bb8a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } } }
I20260809 02:19:19.969669 14036 tablet_replica.cc:442] T 36226b46f901417a9d10dca118fb44fb P 6170c2330cd84de48c973e297cc3bb8a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:19:19.969966 14028 tablet_bootstrap.cc:654] T 36226b46f901417a9d10dca118fb44fb P ef007ba8d18143b4983755af4d2b59c6: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:19.970628 14028 tablet_bootstrap.cc:492] T 36226b46f901417a9d10dca118fb44fb P ef007ba8d18143b4983755af4d2b59c6: No bootstrap required, opened a new log
I20260809 02:19:19.970670 14028 ts_tablet_manager.cc:1397] T 36226b46f901417a9d10dca118fb44fb P ef007ba8d18143b4983755af4d2b59c6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:19.970824 14028 raft_consensus.cc:348] T 36226b46f901417a9d10dca118fb44fb P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:19.970882 14028 raft_consensus.cc:374] T 36226b46f901417a9d10dca118fb44fb P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:19.970896 14028 raft_consensus.cc:729] T 36226b46f901417a9d10dca118fb44fb P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef007ba8d18143b4983755af4d2b59c6, State: Initialized, Role: FOLLOWER
I20260809 02:19:19.970958 14028 consensus_queue.cc:260] T 36226b46f901417a9d10dca118fb44fb P ef007ba8d18143b4983755af4d2b59c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:19.971096 14028 ts_tablet_manager.cc:1428] T 36226b46f901417a9d10dca118fb44fb P ef007ba8d18143b4983755af4d2b59c6: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:19.971175 14034 tablet_replica.cc:439] T 36226b46f901417a9d10dca118fb44fb P ef007ba8d18143b4983755af4d2b59c6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } } }
I20260809 02:19:19.971277 14034 tablet_replica.cc:442] T 36226b46f901417a9d10dca118fb44fb P ef007ba8d18143b4983755af4d2b59c6: This TxnStatusTablet replica's current role is: FOLLOWER
W20260809 02:19:20.041531 13705 tablet.cc:2369] T 36226b46f901417a9d10dca118fb44fb P 6170c2330cd84de48c973e297cc3bb8a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:19:20.112526 14004 tablet.cc:2369] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:19:20.338562 14036 consensus_queue.cc:1035] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:20.341087 14036 consensus_queue.cc:1035] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:20.367383 14035 raft_consensus.cc:482] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:19:20.367484 14035 raft_consensus.cc:504] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:20.367779 14035 leader_election.cc:288] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6170c2330cd84de48c973e297cc3bb8a (127.11.93.129:43721), ef007ba8d18143b4983755af4d2b59c6 (127.11.93.130:33799)
I20260809 02:19:20.371991 14026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:20.368088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:52715 (local address 127.11.93.130:33799)
0809 02:19:20.368140 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:20.368143 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:20.368246 (+ 103us) server_negotiation.cc:407] Connection header received
0809 02:19:20.368311 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:20.368312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:20.368322 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:20.368420 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:20.368658 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.369418 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.371038 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.371590 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.371670 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:20.371680 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:20.371878 (+ 198us) server_negotiation.cc:299] Negotiation successful
0809 02:19:20.371918 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 02:19:20.371991 14024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:20.368087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:34603 (local address 127.11.93.129:43721)
0809 02:19:20.368152 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:20.368154 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:20.368251 (+ 97us) server_negotiation.cc:407] Connection header received
0809 02:19:20.368310 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:20.368311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:20.368322 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:20.368402 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:20.368663 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.369405 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.371046 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.371584 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.371670 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:20.371680 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:20.371885 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 02:19:20.371920 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:19:20.372044 14056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:20.368002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:43721 (local address 127.11.93.131:34603)
0809 02:19:20.368158 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:20.368171 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:20.368243 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:20.368448 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:20.368449 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:20.368452 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:20.368569 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:20.368572 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.369502 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.369503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:20.370900 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:20.370903 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.371717 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.371718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:20.371786 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:20.371793 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 02:19:20.371857 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 02:19:20.371908 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":114,"thread_start_us":106,"threads_started":1}
I20260809 02:19:20.372045 14055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:20.368002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:33799 (local address 127.11.93.131:52715)
0809 02:19:20.368167 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:20.368177 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:20.368243 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:20.368448 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:20.368449 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:20.368453 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:20.368570 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:20.368572 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.369501 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.369503 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:20.370900 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:20.370903 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.371704 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.371705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:20.371786 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:20.371791 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:19:20.371857 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 02:19:20.371909 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":121,"thread_start_us":63,"threads_started":1}
I20260809 02:19:20.372398 13656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36226b46f901417a9d10dca118fb44fb" candidate_uuid: "954e3557e1b74bfb9040a2979f6242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6170c2330cd84de48c973e297cc3bb8a" is_pre_election: true
I20260809 02:19:20.372534 13656 raft_consensus.cc:2454] T 36226b46f901417a9d10dca118fb44fb P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 954e3557e1b74bfb9040a2979f6242ea in term 0.
I20260809 02:19:20.372754 13877 leader_election.cc:302] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6170c2330cd84de48c973e297cc3bb8a, 954e3557e1b74bfb9040a2979f6242ea; no voters:
I20260809 02:19:20.372766 13803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36226b46f901417a9d10dca118fb44fb" candidate_uuid: "954e3557e1b74bfb9040a2979f6242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef007ba8d18143b4983755af4d2b59c6" is_pre_election: true
I20260809 02:19:20.372879 13803 raft_consensus.cc:2454] T 36226b46f901417a9d10dca118fb44fb P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 954e3557e1b74bfb9040a2979f6242ea in term 0.
I20260809 02:19:20.372900 14035 raft_consensus.cc:2781] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:19:20.372939 14035 raft_consensus.cc:482] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:19:20.372969 14035 raft_consensus.cc:3037] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:20.373647 14035 raft_consensus.cc:504] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:20.373802 14035 leader_election.cc:288] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea [CANDIDATE]: Term 1 election: Requested vote from peers 6170c2330cd84de48c973e297cc3bb8a (127.11.93.129:43721), ef007ba8d18143b4983755af4d2b59c6 (127.11.93.130:33799)
I20260809 02:19:20.373966 13656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36226b46f901417a9d10dca118fb44fb" candidate_uuid: "954e3557e1b74bfb9040a2979f6242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6170c2330cd84de48c973e297cc3bb8a"
I20260809 02:19:20.374059 13656 raft_consensus.cc:3037] T 36226b46f901417a9d10dca118fb44fb P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:20.374039 13803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36226b46f901417a9d10dca118fb44fb" candidate_uuid: "954e3557e1b74bfb9040a2979f6242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef007ba8d18143b4983755af4d2b59c6"
I20260809 02:19:20.374117 13803 raft_consensus.cc:3037] T 36226b46f901417a9d10dca118fb44fb P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:20.374702 13803 raft_consensus.cc:2454] T 36226b46f901417a9d10dca118fb44fb P ef007ba8d18143b4983755af4d2b59c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 954e3557e1b74bfb9040a2979f6242ea in term 1.
I20260809 02:19:20.374825 13656 raft_consensus.cc:2454] T 36226b46f901417a9d10dca118fb44fb P 6170c2330cd84de48c973e297cc3bb8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 954e3557e1b74bfb9040a2979f6242ea in term 1.
I20260809 02:19:20.374923 13880 leader_election.cc:302] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 954e3557e1b74bfb9040a2979f6242ea, ef007ba8d18143b4983755af4d2b59c6; no voters:
I20260809 02:19:20.375048 14035 raft_consensus.cc:2781] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:20.375173 14035 raft_consensus.cc:686] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea [term 1 LEADER]: Becoming Leader. State: Replica: 954e3557e1b74bfb9040a2979f6242ea, State: Running, Role: LEADER
I20260809 02:19:20.375263 14035 consensus_queue.cc:237] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:20.375640 14057 tablet_replica.cc:439] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea: TxnStatusTablet state changed. Reason: New leader 954e3557e1b74bfb9040a2979f6242ea. Latest consensus state: current_term: 1 leader_uuid: "954e3557e1b74bfb9040a2979f6242ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } } }
I20260809 02:19:20.375739 14057 tablet_replica.cc:442] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:19:20.375955 14059 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 02:19:20.376046 14059 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 02:19:20.376047 13484 catalog_manager.cc:5495] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 954e3557e1b74bfb9040a2979f6242ea (127.11.93.131). New cstate: current_term: 1 leader_uuid: "954e3557e1b74bfb9040a2979f6242ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } health_report { overall_health: HEALTHY } } }
I20260809 02:19:20.411595 14025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:20.408689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37262 (local address 127.11.93.131:32957)
0809 02:19:20.408755 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:20.408758 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:20.408769 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:19:20.408826 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:20.408827 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:20.408848 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:20.408940 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:19:20.409055 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.409817 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.410585 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.410891 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.410992 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:20.411192 (+ 200us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:19:20.411321 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:19:20.411405 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:20.411487 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 02:19:20.411510 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:19:20.411598 14046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:20.408586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:32957 (local address 127.0.0.1:37262)
0809 02:19:20.408660 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:20.408675 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:20.408725 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:20.408941 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:20.408942 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:20.408943 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:19:20.408990 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:20.408992 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.409914 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.409915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:20.410505 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:20.410508 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.411018 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.411019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:20.411081 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:20.411098 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:19:20.411421 (+ 323us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:19:20.411430 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 02:19:20.411478 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 02:19:20.411527 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 02:19:20.413365 13803 raft_consensus.cc:1261] T 36226b46f901417a9d10dca118fb44fb P ef007ba8d18143b4983755af4d2b59c6 [term 1 FOLLOWER]: Refusing update from remote peer 954e3557e1b74bfb9040a2979f6242ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:20.413489 13656 raft_consensus.cc:1261] T 36226b46f901417a9d10dca118fb44fb P 6170c2330cd84de48c973e297cc3bb8a [term 1 FOLLOWER]: Refusing update from remote peer 954e3557e1b74bfb9040a2979f6242ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:20.413658 14035 consensus_queue.cc:1035] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:20.413844 14035 consensus_queue.cc:1035] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:20.414865 14034 tablet_replica.cc:439] T 36226b46f901417a9d10dca118fb44fb P ef007ba8d18143b4983755af4d2b59c6: TxnStatusTablet state changed. Reason: New leader 954e3557e1b74bfb9040a2979f6242ea. Latest consensus state: current_term: 1 leader_uuid: "954e3557e1b74bfb9040a2979f6242ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } } }
I20260809 02:19:20.414875 14036 tablet_replica.cc:439] T 36226b46f901417a9d10dca118fb44fb P 6170c2330cd84de48c973e297cc3bb8a: TxnStatusTablet state changed. Reason: New leader 954e3557e1b74bfb9040a2979f6242ea. Latest consensus state: current_term: 1 leader_uuid: "954e3557e1b74bfb9040a2979f6242ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } } }
I20260809 02:19:20.414960 14034 tablet_replica.cc:442] T 36226b46f901417a9d10dca118fb44fb P ef007ba8d18143b4983755af4d2b59c6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:19:20.415011 14036 tablet_replica.cc:442] T 36226b46f901417a9d10dca118fb44fb P 6170c2330cd84de48c973e297cc3bb8a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:19:20.415907 14052 mvcc.cc:205] Tried to move back new op lower bound from 7316447069850951680 to 7316447069697757184. Current Snapshot: MvccSnapshot[applied={T|T < 7316447069850951680}]
I20260809 02:19:20.416180 14035 tablet_replica.cc:439] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "954e3557e1b74bfb9040a2979f6242ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } } }
I20260809 02:19:20.416285 14035 tablet_replica.cc:442] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:19:20.416812 14034 tablet_replica.cc:439] T 36226b46f901417a9d10dca118fb44fb P ef007ba8d18143b4983755af4d2b59c6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "954e3557e1b74bfb9040a2979f6242ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } } }
I20260809 02:19:20.416905 14034 tablet_replica.cc:442] T 36226b46f901417a9d10dca118fb44fb P ef007ba8d18143b4983755af4d2b59c6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:19:20.416846 14054 mvcc.cc:205] Tried to move back new op lower bound from 7316447069850951680 to 7316447069697757184. Current Snapshot: MvccSnapshot[applied={T|T < 7316447069850951680}]
I20260809 02:19:20.417999 14064 tablet_replica.cc:439] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "954e3557e1b74bfb9040a2979f6242ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } } }
I20260809 02:19:20.418118 14064 tablet_replica.cc:442] T 36226b46f901417a9d10dca118fb44fb P 954e3557e1b74bfb9040a2979f6242ea: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:19:20.418280 14036 tablet_replica.cc:439] T 36226b46f901417a9d10dca118fb44fb P 6170c2330cd84de48c973e297cc3bb8a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "954e3557e1b74bfb9040a2979f6242ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } } }
I20260809 02:19:20.418362 14036 tablet_replica.cc:442] T 36226b46f901417a9d10dca118fb44fb P 6170c2330cd84de48c973e297cc3bb8a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:19:20.418326 14051 mvcc.cc:205] Tried to move back new op lower bound from 7316447069850951680 to 7316447069697757184. Current Snapshot: MvccSnapshot[applied={T|T < 7316447069850951680}]
I20260809 02:19:20.421868 14024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:20.417788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49670 (local address 127.11.93.129:43721)
0809 02:19:20.417832 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:20.417835 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:20.419164 (+ 1329us) server_negotiation.cc:407] Connection header received
0809 02:19:20.419203 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:20.419204 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:20.419224 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:20.419306 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:19:20.419438 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.420193 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.420944 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.421252 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.421326 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:20.421537 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:19:20.421658 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:19:20.421741 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:20.421765 (+ 24us) server_negotiation.cc:299] Negotiation successful
0809 02:19:20.421789 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 02:19:20.427053 14025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:20.424478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:46595 (local address 127.11.93.131:32957)
0809 02:19:20.424518 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:20.424520 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:20.424661 (+ 141us) server_negotiation.cc:407] Connection header received
0809 02:19:20.424736 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:20.424737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:20.424747 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:20.424802 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:19:20.424928 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.425377 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.426265 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.426475 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.426559 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:20.426751 (+ 192us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:19:20.426783 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:19:20.426852 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:20.426908 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 02:19:20.426928 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 02:19:20.427079 14075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:20.424404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:32957 (local address 127.11.93.129:46595)
0809 02:19:20.424591 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:20.424601 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:20.424676 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:20.424804 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:20.424805 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:20.424806 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:19:20.424865 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:20.424867 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.425467 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.425468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:20.426181 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:20.426183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.426562 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.426564 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:20.426641 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:20.426655 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:19:20.426854 (+ 199us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:19:20.426857 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:19:20.426905 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 02:19:20.426947 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":87,"threads_started":1}
I20260809 02:19:20.437479 14024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:20.434588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:60701 (local address 127.11.93.129:43721)
0809 02:19:20.434626 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:20.434628 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:20.434774 (+ 146us) server_negotiation.cc:407] Connection header received
0809 02:19:20.434897 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:20.434898 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:20.434908 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:20.434955 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:19:20.435089 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.435588 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.436686 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.437002 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.437045 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:20.437260 (+ 215us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:19:20.437292 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:19:20.437336 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:20.437405 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 02:19:20.437423 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 02:19:20.437544 14078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:20.434528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:43721 (local address 127.11.93.131:60701)
0809 02:19:20.434702 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:20.434713 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:20.434829 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:20.434959 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:20.434960 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:20.434962 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:19:20.435028 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:20.435031 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.435666 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.435667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:20.436580 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:20.436583 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.437104 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.437105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:20.437161 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:20.437178 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:19:20.437355 (+ 177us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:19:20.437357 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 02:19:20.437401 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 02:19:20.437447 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":109,"threads_started":1}
I20260809 02:19:20.447079 13482 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41694:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:20.447206 13482 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41694:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:20.447990 13482 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31: Sending DeleteTablet for 3 replicas of tablet 95c3b8b70e844cc895d7e3dfb9d13626
I20260809 02:19:20.448318 13783 tablet_service.cc:1514] Processing DeleteTablet for tablet 95c3b8b70e844cc895d7e3dfb9d13626 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:20 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:57824
I20260809 02:19:20.448350 13934 tablet_service.cc:1514] Processing DeleteTablet for tablet 95c3b8b70e844cc895d7e3dfb9d13626 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:20 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:37258
I20260809 02:19:20.448661 14082 tablet_replica.cc:330] T 95c3b8b70e844cc895d7e3dfb9d13626 P ef007ba8d18143b4983755af4d2b59c6: stopping tablet replica
I20260809 02:19:20.448832 14082 raft_consensus.cc:2229] T 95c3b8b70e844cc895d7e3dfb9d13626 P ef007ba8d18143b4983755af4d2b59c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:20.448912 13635 tablet_service.cc:1514] Processing DeleteTablet for tablet 95c3b8b70e844cc895d7e3dfb9d13626 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:20 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:49658
I20260809 02:19:20.448952 14082 raft_consensus.cc:2258] T 95c3b8b70e844cc895d7e3dfb9d13626 P ef007ba8d18143b4983755af4d2b59c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:20.449195 13482 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41694:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:19:20.449331 13482 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:19:20.449404 14082 ts_tablet_manager.cc:1905] T 95c3b8b70e844cc895d7e3dfb9d13626 P ef007ba8d18143b4983755af4d2b59c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:20.450752 13934 tablet_service.cc:1467] Processing CreateTablet for tablet 8c2511a5f6dc43288dcb6a641ae0fc6c (DEFAULT_TABLE table=test-table [id=6cdf20506d1e48729f067f1438c190ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:20.450758 13783 tablet_service.cc:1467] Processing CreateTablet for tablet 8c2511a5f6dc43288dcb6a641ae0fc6c (DEFAULT_TABLE table=test-table [id=6cdf20506d1e48729f067f1438c190ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:20.450870 13783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c2511a5f6dc43288dcb6a641ae0fc6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:20.450894 13934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c2511a5f6dc43288dcb6a641ae0fc6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:20.452183 14028 tablet_bootstrap.cc:492] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6: Bootstrap starting.
I20260809 02:19:20.452242 14027 tablet_bootstrap.cc:492] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 954e3557e1b74bfb9040a2979f6242ea: Bootstrap starting.
I20260809 02:19:20.452543 14027 tablet_bootstrap.cc:654] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 954e3557e1b74bfb9040a2979f6242ea: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:20.452562 14028 tablet_bootstrap.cc:654] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:20.452818 13635 tablet_service.cc:1467] Processing CreateTablet for tablet 8c2511a5f6dc43288dcb6a641ae0fc6c (DEFAULT_TABLE table=test-table [id=6cdf20506d1e48729f067f1438c190ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:20.452955 13635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c2511a5f6dc43288dcb6a641ae0fc6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:20.453634 14082 ts_tablet_manager.cc:1918] T 95c3b8b70e844cc895d7e3dfb9d13626 P ef007ba8d18143b4983755af4d2b59c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:19:20.453701 14082 log.cc:1196] T 95c3b8b70e844cc895d7e3dfb9d13626 P ef007ba8d18143b4983755af4d2b59c6: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/95c3b8b70e844cc895d7e3dfb9d13626
I20260809 02:19:20.453981 14082 ts_tablet_manager.cc:1939] T 95c3b8b70e844cc895d7e3dfb9d13626 P ef007ba8d18143b4983755af4d2b59c6: Deleting consensus metadata
I20260809 02:19:20.454257 14029 tablet_bootstrap.cc:492] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a: Bootstrap starting.
I20260809 02:19:20.454471 13468 catalog_manager.cc:4841] TS ef007ba8d18143b4983755af4d2b59c6 (127.11.93.130:33799): tablet 95c3b8b70e844cc895d7e3dfb9d13626 (table test-table [id=b4b14364724148339e10983e18041a70]) successfully deleted
I20260809 02:19:20.454653 14029 tablet_bootstrap.cc:654] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:20.454865 14028 tablet_bootstrap.cc:492] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6: No bootstrap required, opened a new log
I20260809 02:19:20.454905 14028 ts_tablet_manager.cc:1397] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260809 02:19:20.455084 14028 raft_consensus.cc:348] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:20.455163 14028 raft_consensus.cc:374] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:20.455183 14028 raft_consensus.cc:729] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef007ba8d18143b4983755af4d2b59c6, State: Initialized, Role: FOLLOWER
I20260809 02:19:20.455221 14028 consensus_queue.cc:260] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:20.455302 14028 ts_tablet_manager.cc:1428] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:20.455780 14029 tablet_bootstrap.cc:492] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a: No bootstrap required, opened a new log
I20260809 02:19:20.455826 14029 ts_tablet_manager.cc:1397] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 02:19:20.455976 14029 raft_consensus.cc:348] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:20.456040 14029 raft_consensus.cc:374] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:20.456061 14029 raft_consensus.cc:729] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6170c2330cd84de48c973e297cc3bb8a, State: Initialized, Role: FOLLOWER
I20260809 02:19:20.456107 14029 consensus_queue.cc:260] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:20.456202 14029 ts_tablet_manager.cc:1428] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:20.456420 14085 tablet_replica.cc:330] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a: stopping tablet replica
I20260809 02:19:20.456568 14085 raft_consensus.cc:2229] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:19:20.456719 14085 raft_consensus.cc:2258] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:20.457166 14084 tablet_replica.cc:330] T 95c3b8b70e844cc895d7e3dfb9d13626 P 954e3557e1b74bfb9040a2979f6242ea: stopping tablet replica
I20260809 02:19:20.457442 14085 ts_tablet_manager.cc:1905] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:20.459020 14085 ts_tablet_manager.cc:1918] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:19:20.459093 14085 log.cc:1196] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-0/wal/wals/95c3b8b70e844cc895d7e3dfb9d13626
I20260809 02:19:20.459396 14085 ts_tablet_manager.cc:1939] T 95c3b8b70e844cc895d7e3dfb9d13626 P 6170c2330cd84de48c973e297cc3bb8a: Deleting consensus metadata
I20260809 02:19:20.459805 14084 raft_consensus.cc:2229] T 95c3b8b70e844cc895d7e3dfb9d13626 P 954e3557e1b74bfb9040a2979f6242ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:20.459836 13465 catalog_manager.cc:4841] TS 6170c2330cd84de48c973e297cc3bb8a (127.11.93.129:43721): tablet 95c3b8b70e844cc895d7e3dfb9d13626 (table test-table [id=b4b14364724148339e10983e18041a70]) successfully deleted
I20260809 02:19:20.459962 14084 raft_consensus.cc:2258] T 95c3b8b70e844cc895d7e3dfb9d13626 P 954e3557e1b74bfb9040a2979f6242ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:20.460315 14084 ts_tablet_manager.cc:1905] T 95c3b8b70e844cc895d7e3dfb9d13626 P 954e3557e1b74bfb9040a2979f6242ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:20.462073 14084 ts_tablet_manager.cc:1918] T 95c3b8b70e844cc895d7e3dfb9d13626 P 954e3557e1b74bfb9040a2979f6242ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:19:20.462148 14084 log.cc:1196] T 95c3b8b70e844cc895d7e3dfb9d13626 P 954e3557e1b74bfb9040a2979f6242ea: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/95c3b8b70e844cc895d7e3dfb9d13626
I20260809 02:19:20.462414 14084 ts_tablet_manager.cc:1939] T 95c3b8b70e844cc895d7e3dfb9d13626 P 954e3557e1b74bfb9040a2979f6242ea: Deleting consensus metadata
I20260809 02:19:20.462903 13466 catalog_manager.cc:4841] TS 954e3557e1b74bfb9040a2979f6242ea (127.11.93.131:32957): tablet 95c3b8b70e844cc895d7e3dfb9d13626 (table test-table [id=b4b14364724148339e10983e18041a70]) successfully deleted
I20260809 02:19:20.463358 14027 tablet_bootstrap.cc:492] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 954e3557e1b74bfb9040a2979f6242ea: No bootstrap required, opened a new log
I20260809 02:19:20.463413 14027 ts_tablet_manager.cc:1397] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 954e3557e1b74bfb9040a2979f6242ea: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.001s
I20260809 02:19:20.463558 14027 raft_consensus.cc:348] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:20.463630 14027 raft_consensus.cc:374] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:20.463651 14027 raft_consensus.cc:729] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 954e3557e1b74bfb9040a2979f6242ea, State: Initialized, Role: FOLLOWER
I20260809 02:19:20.463692 14027 consensus_queue.cc:260] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 954e3557e1b74bfb9040a2979f6242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:20.463776 14027 ts_tablet_manager.cc:1428] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 954e3557e1b74bfb9040a2979f6242ea: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:20.534837 14034 raft_consensus.cc:482] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:19:20.534950 14034 raft_consensus.cc:504] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:20.535315 14079 raft_consensus.cc:482] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:19:20.535386 14034 leader_election.cc:288] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6170c2330cd84de48c973e297cc3bb8a (127.11.93.129:43721), 954e3557e1b74bfb9040a2979f6242ea (127.11.93.131:32957)
I20260809 02:19:20.535395 14079 raft_consensus.cc:504] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:20.535547 14079 leader_election.cc:288] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef007ba8d18143b4983755af4d2b59c6 (127.11.93.130:33799), 954e3557e1b74bfb9040a2979f6242ea (127.11.93.131:32957)
I20260809 02:19:20.535967 13803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c2511a5f6dc43288dcb6a641ae0fc6c" candidate_uuid: "6170c2330cd84de48c973e297cc3bb8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef007ba8d18143b4983755af4d2b59c6" is_pre_election: true
I20260809 02:19:20.536056 13803 raft_consensus.cc:2454] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6170c2330cd84de48c973e297cc3bb8a in term 0.
I20260809 02:19:20.536088 13954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c2511a5f6dc43288dcb6a641ae0fc6c" candidate_uuid: "6170c2330cd84de48c973e297cc3bb8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "954e3557e1b74bfb9040a2979f6242ea" is_pre_election: true
I20260809 02:19:20.536192 13954 raft_consensus.cc:2454] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6170c2330cd84de48c973e297cc3bb8a in term 0.
I20260809 02:19:20.536329 13581 leader_election.cc:302] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6170c2330cd84de48c973e297cc3bb8a, 954e3557e1b74bfb9040a2979f6242ea; no voters:
I20260809 02:19:20.536475 14079 raft_consensus.cc:2781] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:19:20.536525 14079 raft_consensus.cc:482] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:19:20.536545 14079 raft_consensus.cc:3037] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:20.537426 14079 raft_consensus.cc:504] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:20.537560 14079 leader_election.cc:288] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a [CANDIDATE]: Term 1 election: Requested vote from peers ef007ba8d18143b4983755af4d2b59c6 (127.11.93.130:33799), 954e3557e1b74bfb9040a2979f6242ea (127.11.93.131:32957)
I20260809 02:19:20.537730 13954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c2511a5f6dc43288dcb6a641ae0fc6c" candidate_uuid: "6170c2330cd84de48c973e297cc3bb8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "954e3557e1b74bfb9040a2979f6242ea"
I20260809 02:19:20.537791 13954 raft_consensus.cc:3037] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:20.538646 13954 raft_consensus.cc:2454] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 954e3557e1b74bfb9040a2979f6242ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6170c2330cd84de48c973e297cc3bb8a in term 1.
I20260809 02:19:20.538837 13581 leader_election.cc:302] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6170c2330cd84de48c973e297cc3bb8a, 954e3557e1b74bfb9040a2979f6242ea; no voters:
I20260809 02:19:20.539233 13803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c2511a5f6dc43288dcb6a641ae0fc6c" candidate_uuid: "6170c2330cd84de48c973e297cc3bb8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef007ba8d18143b4983755af4d2b59c6"
I20260809 02:19:20.539307 13803 raft_consensus.cc:3037] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:20.539388 14024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:20.535745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:52351 (local address 127.11.93.129:43721)
0809 02:19:20.535793 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:20.535795 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:20.535869 (+ 74us) server_negotiation.cc:407] Connection header received
0809 02:19:20.536008 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:20.536009 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:20.536022 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:20.536053 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:20.536293 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.537014 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.538440 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.538955 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.539033 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:20.539042 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:20.539268 (+ 226us) server_negotiation.cc:299] Negotiation successful
0809 02:19:20.539309 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 02:19:20.539606 14089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:20.535574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:43721 (local address 127.11.93.130:52351)
0809 02:19:20.535789 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:20.535804 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:20.535923 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:20.536128 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:20.536129 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:20.536130 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:20.536208 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:20.536210 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.537101 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.537101 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:20.538338 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:20.538341 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.539097 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.539098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:20.539170 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:20.539174 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:19:20.539462 (+ 288us) client_negotiation.cc:240] Negotiation successful
0809 02:19:20.539508 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":73,"threads_started":1}
I20260809 02:19:20.539666 14025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:20.535855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:57099 (local address 127.11.93.131:32957)
0809 02:19:20.535932 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:20.535934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:20.536539 (+ 605us) server_negotiation.cc:407] Connection header received
0809 02:19:20.536628 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:20.536629 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:20.536642 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:20.536669 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:20.536852 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.537504 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.538725 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.539282 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.539322 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:20.539328 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:20.539564 (+ 236us) server_negotiation.cc:299] Negotiation successful
0809 02:19:20.539600 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 02:19:20.539855 14090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:20.535637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:32957 (local address 127.11.93.130:57099)
0809 02:19:20.536477 (+ 840us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:20.536487 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:20.536564 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:20.536723 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:20.536723 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:20.536725 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:20.536789 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:20.536790 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.537600 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.537600 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:20.538637 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:20.538639 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:20.539381 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:20.539382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:20.539480 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:20.539483 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:19:20.539729 (+ 246us) client_negotiation.cc:240] Negotiation successful
0809 02:19:20.539776 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":822,"thread_start_us":110,"threads_started":1}
I20260809 02:19:20.539883 13656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c2511a5f6dc43288dcb6a641ae0fc6c" candidate_uuid: "ef007ba8d18143b4983755af4d2b59c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6170c2330cd84de48c973e297cc3bb8a" is_pre_election: true
I20260809 02:19:20.540004 13656 raft_consensus.cc:2379] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef007ba8d18143b4983755af4d2b59c6 in current term 1: Already voted for candidate 6170c2330cd84de48c973e297cc3bb8a in this term.
I20260809 02:19:20.540051 14079 raft_consensus.cc:2781] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:20.540094 14079 raft_consensus.cc:686] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a [term 1 LEADER]: Becoming Leader. State: Replica: 6170c2330cd84de48c973e297cc3bb8a, State: Running, Role: LEADER
I20260809 02:19:20.540095 13803 raft_consensus.cc:2454] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6170c2330cd84de48c973e297cc3bb8a in term 1.
I20260809 02:19:20.540148 14079 consensus_queue.cc:237] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:20.540798 13482 catalog_manager.cc:5495] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6170c2330cd84de48c973e297cc3bb8a (127.11.93.129). New cstate: current_term: 1 leader_uuid: "6170c2330cd84de48c973e297cc3bb8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } health_report { overall_health: UNKNOWN } } }
I20260809 02:19:20.541440 13954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c2511a5f6dc43288dcb6a641ae0fc6c" candidate_uuid: "ef007ba8d18143b4983755af4d2b59c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "954e3557e1b74bfb9040a2979f6242ea" is_pre_election: true
I20260809 02:19:20.541538 13954 raft_consensus.cc:2379] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 954e3557e1b74bfb9040a2979f6242ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef007ba8d18143b4983755af4d2b59c6 in current term 1: Already voted for candidate 6170c2330cd84de48c973e297cc3bb8a in this term.
I20260809 02:19:20.541760 13730 leader_election.cc:302] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef007ba8d18143b4983755af4d2b59c6; no voters: 6170c2330cd84de48c973e297cc3bb8a, 954e3557e1b74bfb9040a2979f6242ea
I20260809 02:19:20.541893 14034 raft_consensus.cc:2726] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260809 02:19:20.553546 13803 raft_consensus.cc:1261] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6 [term 1 FOLLOWER]: Refusing update from remote peer 6170c2330cd84de48c973e297cc3bb8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:20.553704 13954 raft_consensus.cc:1261] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 954e3557e1b74bfb9040a2979f6242ea [term 1 FOLLOWER]: Refusing update from remote peer 6170c2330cd84de48c973e297cc3bb8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:20.553803 14079 consensus_queue.cc:1035] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:20.553916 14036 consensus_queue.cc:1035] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 02:19:20.559114 14051 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 02:19:22.077633 13484 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41694:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:22.077765 13484 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41694:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:22.078667 13484 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31: Sending DeleteTablet for 3 replicas of tablet 8c2511a5f6dc43288dcb6a641ae0fc6c
I20260809 02:19:22.078924 13783 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c2511a5f6dc43288dcb6a641ae0fc6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:22 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:57824
I20260809 02:19:22.078950 13934 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c2511a5f6dc43288dcb6a641ae0fc6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:22 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:37258
I20260809 02:19:22.079021 13635 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c2511a5f6dc43288dcb6a641ae0fc6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:22 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:49658
I20260809 02:19:22.079483 14116 tablet_replica.cc:330] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6: stopping tablet replica
I20260809 02:19:22.079555 14116 raft_consensus.cc:2229] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:22.079592 14116 raft_consensus.cc:2258] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:22.079857 14116 ts_tablet_manager.cc:1905] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:22.081789 14116 ts_tablet_manager.cc:1918] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 02:19:22.081863 14116 log.cc:1196] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/8c2511a5f6dc43288dcb6a641ae0fc6c
I20260809 02:19:22.081871 14117 tablet_replica.cc:330] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 954e3557e1b74bfb9040a2979f6242ea: stopping tablet replica
I20260809 02:19:22.081954 14117 raft_consensus.cc:2229] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 954e3557e1b74bfb9040a2979f6242ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:22.081997 14117 raft_consensus.cc:2258] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 954e3557e1b74bfb9040a2979f6242ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:22.082115 14118 tablet_replica.cc:330] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a: stopping tablet replica
I20260809 02:19:22.082129 14116 ts_tablet_manager.cc:1939] T 8c2511a5f6dc43288dcb6a641ae0fc6c P ef007ba8d18143b4983755af4d2b59c6: Deleting consensus metadata
I20260809 02:19:22.082268 14117 ts_tablet_manager.cc:1905] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 954e3557e1b74bfb9040a2979f6242ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:22.082422 13468 catalog_manager.cc:4841] TS ef007ba8d18143b4983755af4d2b59c6 (127.11.93.130:33799): tablet 8c2511a5f6dc43288dcb6a641ae0fc6c (table test-table [id=6cdf20506d1e48729f067f1438c190ca]) successfully deleted
I20260809 02:19:22.082530 14118 raft_consensus.cc:2229] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:19:22.082592 14118 raft_consensus.cc:2258] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:22.083662 14117 ts_tablet_manager.cc:1918] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 954e3557e1b74bfb9040a2979f6242ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 02:19:22.083742 14117 log.cc:1196] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 954e3557e1b74bfb9040a2979f6242ea: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/8c2511a5f6dc43288dcb6a641ae0fc6c
I20260809 02:19:22.084026 14117 ts_tablet_manager.cc:1939] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 954e3557e1b74bfb9040a2979f6242ea: Deleting consensus metadata
I20260809 02:19:22.084350 13466 catalog_manager.cc:4841] TS 954e3557e1b74bfb9040a2979f6242ea (127.11.93.131:32957): tablet 8c2511a5f6dc43288dcb6a641ae0fc6c (table test-table [id=6cdf20506d1e48729f067f1438c190ca]) successfully deleted
I20260809 02:19:22.084918 14118 ts_tablet_manager.cc:1905] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:22.086314 14118 ts_tablet_manager.cc:1918] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 02:19:22.086383 14118 log.cc:1196] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-0/wal/wals/8c2511a5f6dc43288dcb6a641ae0fc6c
I20260809 02:19:22.086639 14118 ts_tablet_manager.cc:1939] T 8c2511a5f6dc43288dcb6a641ae0fc6c P 6170c2330cd84de48c973e297cc3bb8a: Deleting consensus metadata
I20260809 02:19:22.086958 13465 catalog_manager.cc:4841] TS 6170c2330cd84de48c973e297cc3bb8a (127.11.93.129:43721): tablet 8c2511a5f6dc43288dcb6a641ae0fc6c (table test-table [id=6cdf20506d1e48729f067f1438c190ca]) successfully deleted
Aug 09 02:19:22 dist-test-slave-w206 krb5kdc[13432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241962, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 02:19:22 dist-test-slave-w206 krb5kdc[13432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241962, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:22.104126 14126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:22.096454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41714 (local address 127.11.93.190:40905)
0809 02:19:22.096610 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:22.096612 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:22.096673 (+ 61us) server_negotiation.cc:407] Connection header received
0809 02:19:22.096769 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:22.096771 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:22.096784 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:22.096857 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:22.097443 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:22.097976 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:22.098760 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:22.099041 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:22.099134 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:22.101455 (+ 2321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:22.101456 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:22.101457 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:22.101465 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:22.102814 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:22.103262 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:22.103263 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:22.103264 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:22.103329 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:22.103542 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:22.103543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:22.103543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:22.103663 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:22.103777 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:22.103924 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 02:19:22.104012 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":77,"threads_started":1}
I20260809 02:19:22.105763 13484 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41714:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:19:22.106043 13484 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:19:22.107620 13635 tablet_service.cc:1467] Processing CreateTablet for tablet e9fc60ceac8d41638e04651c9f1a7d58 (DEFAULT_TABLE table=test-table [id=037740e334c34b8ab17bb0af1a626eff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:22.107642 13934 tablet_service.cc:1467] Processing CreateTablet for tablet e9fc60ceac8d41638e04651c9f1a7d58 (DEFAULT_TABLE table=test-table [id=037740e334c34b8ab17bb0af1a626eff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:22.107637 13783 tablet_service.cc:1467] Processing CreateTablet for tablet e9fc60ceac8d41638e04651c9f1a7d58 (DEFAULT_TABLE table=test-table [id=037740e334c34b8ab17bb0af1a626eff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:22.107772 13934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9fc60ceac8d41638e04651c9f1a7d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:22.107774 13635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9fc60ceac8d41638e04651c9f1a7d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:22.107791 13783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9fc60ceac8d41638e04651c9f1a7d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:22.109328 14128 tablet_bootstrap.cc:492] T e9fc60ceac8d41638e04651c9f1a7d58 P 6170c2330cd84de48c973e297cc3bb8a: Bootstrap starting.
I20260809 02:19:22.109457 14127 tablet_bootstrap.cc:492] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6: Bootstrap starting.
I20260809 02:19:22.109495 14129 tablet_bootstrap.cc:492] T e9fc60ceac8d41638e04651c9f1a7d58 P 954e3557e1b74bfb9040a2979f6242ea: Bootstrap starting.
I20260809 02:19:22.109750 14128 tablet_bootstrap.cc:654] T e9fc60ceac8d41638e04651c9f1a7d58 P 6170c2330cd84de48c973e297cc3bb8a: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:22.109894 14127 tablet_bootstrap.cc:654] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:22.109890 14129 tablet_bootstrap.cc:654] T e9fc60ceac8d41638e04651c9f1a7d58 P 954e3557e1b74bfb9040a2979f6242ea: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:22.110437 14128 tablet_bootstrap.cc:492] T e9fc60ceac8d41638e04651c9f1a7d58 P 6170c2330cd84de48c973e297cc3bb8a: No bootstrap required, opened a new log
I20260809 02:19:22.110500 14128 ts_tablet_manager.cc:1397] T e9fc60ceac8d41638e04651c9f1a7d58 P 6170c2330cd84de48c973e297cc3bb8a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:22.110509 14127 tablet_bootstrap.cc:492] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6: No bootstrap required, opened a new log
I20260809 02:19:22.110525 14129 tablet_bootstrap.cc:492] T e9fc60ceac8d41638e04651c9f1a7d58 P 954e3557e1b74bfb9040a2979f6242ea: No bootstrap required, opened a new log
I20260809 02:19:22.110553 14127 ts_tablet_manager.cc:1397] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:22.110595 14129 ts_tablet_manager.cc:1397] T e9fc60ceac8d41638e04651c9f1a7d58 P 954e3557e1b74bfb9040a2979f6242ea: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:22.110620 14128 raft_consensus.cc:348] T e9fc60ceac8d41638e04651c9f1a7d58 P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:22.110689 14128 raft_consensus.cc:374] T e9fc60ceac8d41638e04651c9f1a7d58 P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:22.110661 14127 raft_consensus.cc:348] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:22.110709 14128 raft_consensus.cc:729] T e9fc60ceac8d41638e04651c9f1a7d58 P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6170c2330cd84de48c973e297cc3bb8a, State: Initialized, Role: FOLLOWER
I20260809 02:19:22.110729 14127 raft_consensus.cc:374] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:22.110709 14129 raft_consensus.cc:348] T e9fc60ceac8d41638e04651c9f1a7d58 P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:22.110751 14127 raft_consensus.cc:729] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef007ba8d18143b4983755af4d2b59c6, State: Initialized, Role: FOLLOWER
I20260809 02:19:22.110772 14128 consensus_queue.cc:260] T e9fc60ceac8d41638e04651c9f1a7d58 P 6170c2330cd84de48c973e297cc3bb8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:22.110781 14129 raft_consensus.cc:374] T e9fc60ceac8d41638e04651c9f1a7d58 P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:22.110800 14127 consensus_queue.cc:260] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:22.110836 14129 raft_consensus.cc:729] T e9fc60ceac8d41638e04651c9f1a7d58 P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 954e3557e1b74bfb9040a2979f6242ea, State: Initialized, Role: FOLLOWER
I20260809 02:19:22.110888 14128 ts_tablet_manager.cc:1428] T e9fc60ceac8d41638e04651c9f1a7d58 P 6170c2330cd84de48c973e297cc3bb8a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:22.110908 14129 consensus_queue.cc:260] T e9fc60ceac8d41638e04651c9f1a7d58 P 954e3557e1b74bfb9040a2979f6242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:22.111032 14127 ts_tablet_manager.cc:1428] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:22.111088 14129 ts_tablet_manager.cc:1428] T e9fc60ceac8d41638e04651c9f1a7d58 P 954e3557e1b74bfb9040a2979f6242ea: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:22.294734 14133 raft_consensus.cc:482] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:19:22.294837 14133 raft_consensus.cc:504] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:22.295053 14133 leader_election.cc:288] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6170c2330cd84de48c973e297cc3bb8a (127.11.93.129:43721), 954e3557e1b74bfb9040a2979f6242ea (127.11.93.131:32957)
I20260809 02:19:22.295291 13656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9fc60ceac8d41638e04651c9f1a7d58" candidate_uuid: "ef007ba8d18143b4983755af4d2b59c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6170c2330cd84de48c973e297cc3bb8a" is_pre_election: true
I20260809 02:19:22.295305 13954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9fc60ceac8d41638e04651c9f1a7d58" candidate_uuid: "ef007ba8d18143b4983755af4d2b59c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "954e3557e1b74bfb9040a2979f6242ea" is_pre_election: true
I20260809 02:19:22.295413 13656 raft_consensus.cc:2454] T e9fc60ceac8d41638e04651c9f1a7d58 P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef007ba8d18143b4983755af4d2b59c6 in term 0.
I20260809 02:19:22.295455 13954 raft_consensus.cc:2454] T e9fc60ceac8d41638e04651c9f1a7d58 P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef007ba8d18143b4983755af4d2b59c6 in term 0.
I20260809 02:19:22.295609 13729 leader_election.cc:302] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6170c2330cd84de48c973e297cc3bb8a, ef007ba8d18143b4983755af4d2b59c6; no voters:
I20260809 02:19:22.295728 14133 raft_consensus.cc:2781] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:19:22.295778 14133 raft_consensus.cc:482] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:19:22.295794 14133 raft_consensus.cc:3037] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:22.296432 14133 raft_consensus.cc:504] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:22.296579 14133 leader_election.cc:288] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6 [CANDIDATE]: Term 1 election: Requested vote from peers 6170c2330cd84de48c973e297cc3bb8a (127.11.93.129:43721), 954e3557e1b74bfb9040a2979f6242ea (127.11.93.131:32957)
I20260809 02:19:22.296731 13656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9fc60ceac8d41638e04651c9f1a7d58" candidate_uuid: "ef007ba8d18143b4983755af4d2b59c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6170c2330cd84de48c973e297cc3bb8a"
I20260809 02:19:22.296728 13954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9fc60ceac8d41638e04651c9f1a7d58" candidate_uuid: "ef007ba8d18143b4983755af4d2b59c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "954e3557e1b74bfb9040a2979f6242ea"
I20260809 02:19:22.296808 13954 raft_consensus.cc:3037] T e9fc60ceac8d41638e04651c9f1a7d58 P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:22.296808 13656 raft_consensus.cc:3037] T e9fc60ceac8d41638e04651c9f1a7d58 P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:22.297590 13656 raft_consensus.cc:2454] T e9fc60ceac8d41638e04651c9f1a7d58 P 6170c2330cd84de48c973e297cc3bb8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef007ba8d18143b4983755af4d2b59c6 in term 1.
I20260809 02:19:22.297590 13954 raft_consensus.cc:2454] T e9fc60ceac8d41638e04651c9f1a7d58 P 954e3557e1b74bfb9040a2979f6242ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef007ba8d18143b4983755af4d2b59c6 in term 1.
I20260809 02:19:22.297770 13729 leader_election.cc:302] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6170c2330cd84de48c973e297cc3bb8a, ef007ba8d18143b4983755af4d2b59c6; no voters:
I20260809 02:19:22.297881 14133 raft_consensus.cc:2781] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:22.298055 14133 raft_consensus.cc:686] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6 [term 1 LEADER]: Becoming Leader. State: Replica: ef007ba8d18143b4983755af4d2b59c6, State: Running, Role: LEADER
I20260809 02:19:22.298118 14133 consensus_queue.cc:237] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:22.298959 13482 catalog_manager.cc:5495] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef007ba8d18143b4983755af4d2b59c6 (127.11.93.130). New cstate: current_term: 1 leader_uuid: "ef007ba8d18143b4983755af4d2b59c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } health_report { overall_health: UNKNOWN } } }
I20260809 02:19:22.341504 14137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:22.339102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57830 (local address 127.11.93.130:33799)
0809 02:19:22.339255 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:22.339257 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:22.339265 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:19:22.339311 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:22.339312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:22.339332 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:22.339408 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:19:22.339519 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:22.340006 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:22.340798 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:22.341010 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:22.341063 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:22.341210 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:19:22.341318 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:19:22.341369 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:22.341425 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 02:19:22.341443 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":107,"threads_started":1}
I20260809 02:19:22.346737 14140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:22.344116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:32957 (local address 127.11.93.130:59427)
0809 02:19:22.344342 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:22.344354 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:22.344435 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:22.344562 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:22.344562 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:22.344564 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:19:22.344611 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:22.344613 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:22.345206 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:22.345207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:22.345890 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:22.345893 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:22.346256 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:22.346257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:22.346311 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:22.346325 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:19:22.346584 (+ 259us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:19:22.346586 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 02:19:22.346626 (+ 40us) client_negotiation.cc:240] Negotiation successful
0809 02:19:22.346663 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":108,"threads_started":1}
I20260809 02:19:22.346720 14141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:22.344161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:59427 (local address 127.11.93.131:32957)
0809 02:19:22.344356 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:22.344358 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:22.344423 (+ 65us) server_negotiation.cc:407] Connection header received
0809 02:19:22.344486 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:22.344486 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:22.344496 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:22.344546 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:19:22.344657 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:22.345142 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:22.345966 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:22.346179 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:22.346236 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:22.346466 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:19:22.346500 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:19:22.346561 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:22.346628 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 02:19:22.346650 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":135,"threads_started":1}
I20260809 02:19:22.349176 13954 raft_consensus.cc:1261] T e9fc60ceac8d41638e04651c9f1a7d58 P 954e3557e1b74bfb9040a2979f6242ea [term 1 FOLLOWER]: Refusing update from remote peer ef007ba8d18143b4983755af4d2b59c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:22.349210 13656 raft_consensus.cc:1261] T e9fc60ceac8d41638e04651c9f1a7d58 P 6170c2330cd84de48c973e297cc3bb8a [term 1 FOLLOWER]: Refusing update from remote peer ef007ba8d18143b4983755af4d2b59c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:22.349485 14134 consensus_queue.cc:1035] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:22.349645 14133 consensus_queue.cc:1035] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:22.357156 14137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:22.354666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:58159 (local address 127.11.93.130:33799)
0809 02:19:22.354703 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:22.354705 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:22.354860 (+ 155us) server_negotiation.cc:407] Connection header received
0809 02:19:22.354932 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:22.354933 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:22.354944 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:22.355029 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:19:22.355143 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:22.355587 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:22.356434 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:22.356705 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:22.356773 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:22.356946 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:19:22.356980 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:19:22.357039 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:22.357088 (+ 49us) server_negotiation.cc:299] Negotiation successful
0809 02:19:22.357105 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 02:19:22.357187 14147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:22.354654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:33799 (local address 127.11.93.131:58159)
0809 02:19:22.354799 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:22.354811 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:22.354877 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:22.355039 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:22.355040 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:22.355042 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:19:22.355096 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:22.355098 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:22.355663 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:22.355664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:22.356338 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:22.356341 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:22.356789 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:22.356790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:22.356862 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:22.356869 (+ 7us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:19:22.357042 (+ 173us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:19:22.357044 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 02:19:22.357084 (+ 40us) client_negotiation.cc:240] Negotiation successful
0809 02:19:22.357126 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":100,"threads_started":1}
I20260809 02:19:22.363806 13481 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41714:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:22.363931 13481 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41714:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:22.364665 13481 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31: Sending DeleteTablet for 3 replicas of tablet e9fc60ceac8d41638e04651c9f1a7d58
I20260809 02:19:22.364930 13934 tablet_service.cc:1514] Processing DeleteTablet for tablet e9fc60ceac8d41638e04651c9f1a7d58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:22 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:37258
I20260809 02:19:22.365048 13635 tablet_service.cc:1514] Processing DeleteTablet for tablet e9fc60ceac8d41638e04651c9f1a7d58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:22 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:49658
I20260809 02:19:22.365108 14117 tablet_replica.cc:330] T e9fc60ceac8d41638e04651c9f1a7d58 P 954e3557e1b74bfb9040a2979f6242ea: stopping tablet replica
I20260809 02:19:22.365108 13783 tablet_service.cc:1514] Processing DeleteTablet for tablet e9fc60ceac8d41638e04651c9f1a7d58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:22 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:57824
I20260809 02:19:22.365162 14117 raft_consensus.cc:2229] T e9fc60ceac8d41638e04651c9f1a7d58 P 954e3557e1b74bfb9040a2979f6242ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:22.365222 14117 raft_consensus.cc:2258] T e9fc60ceac8d41638e04651c9f1a7d58 P 954e3557e1b74bfb9040a2979f6242ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:22.365223 14116 tablet_replica.cc:330] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6: stopping tablet replica
I20260809 02:19:22.365278 14116 raft_consensus.cc:2229] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:19:22.365295 14118 tablet_replica.cc:330] T e9fc60ceac8d41638e04651c9f1a7d58 P 6170c2330cd84de48c973e297cc3bb8a: stopping tablet replica
I20260809 02:19:22.365346 14116 raft_consensus.cc:2258] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:22.365345 14118 raft_consensus.cc:2229] T e9fc60ceac8d41638e04651c9f1a7d58 P 6170c2330cd84de48c973e297cc3bb8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:22.365391 14118 raft_consensus.cc:2258] T e9fc60ceac8d41638e04651c9f1a7d58 P 6170c2330cd84de48c973e297cc3bb8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:22.365641 14116 ts_tablet_manager.cc:1905] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:22.365957 14117 ts_tablet_manager.cc:1905] T e9fc60ceac8d41638e04651c9f1a7d58 P 954e3557e1b74bfb9040a2979f6242ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:22.366276 14118 ts_tablet_manager.cc:1905] T e9fc60ceac8d41638e04651c9f1a7d58 P 6170c2330cd84de48c973e297cc3bb8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:22.367588 14116 ts_tablet_manager.cc:1918] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:19:22.367640 14116 log.cc:1196] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/e9fc60ceac8d41638e04651c9f1a7d58
I20260809 02:19:22.367866 14116 ts_tablet_manager.cc:1939] T e9fc60ceac8d41638e04651c9f1a7d58 P ef007ba8d18143b4983755af4d2b59c6: Deleting consensus metadata
I20260809 02:19:22.367915 14118 ts_tablet_manager.cc:1918] T e9fc60ceac8d41638e04651c9f1a7d58 P 6170c2330cd84de48c973e297cc3bb8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:19:22.367926 14117 ts_tablet_manager.cc:1918] T e9fc60ceac8d41638e04651c9f1a7d58 P 954e3557e1b74bfb9040a2979f6242ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:19:22.367964 14118 log.cc:1196] T e9fc60ceac8d41638e04651c9f1a7d58 P 6170c2330cd84de48c973e297cc3bb8a: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-0/wal/wals/e9fc60ceac8d41638e04651c9f1a7d58
I20260809 02:19:22.367982 14117 log.cc:1196] T e9fc60ceac8d41638e04651c9f1a7d58 P 954e3557e1b74bfb9040a2979f6242ea: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/e9fc60ceac8d41638e04651c9f1a7d58
I20260809 02:19:22.368185 14118 ts_tablet_manager.cc:1939] T e9fc60ceac8d41638e04651c9f1a7d58 P 6170c2330cd84de48c973e297cc3bb8a: Deleting consensus metadata
I20260809 02:19:22.368206 13468 catalog_manager.cc:4841] TS ef007ba8d18143b4983755af4d2b59c6 (127.11.93.130:33799): tablet e9fc60ceac8d41638e04651c9f1a7d58 (table test-table [id=037740e334c34b8ab17bb0af1a626eff]) successfully deleted
I20260809 02:19:22.368253 14117 ts_tablet_manager.cc:1939] T e9fc60ceac8d41638e04651c9f1a7d58 P 954e3557e1b74bfb9040a2979f6242ea: Deleting consensus metadata
I20260809 02:19:22.368471 13481 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41714:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:19:22.368633 13481 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:19:22.368667 13465 catalog_manager.cc:4841] TS 6170c2330cd84de48c973e297cc3bb8a (127.11.93.129:43721): tablet e9fc60ceac8d41638e04651c9f1a7d58 (table test-table [id=037740e334c34b8ab17bb0af1a626eff]) successfully deleted
I20260809 02:19:22.368667 13466 catalog_manager.cc:4841] TS 954e3557e1b74bfb9040a2979f6242ea (127.11.93.131:32957): tablet e9fc60ceac8d41638e04651c9f1a7d58 (table test-table [id=037740e334c34b8ab17bb0af1a626eff]) successfully deleted
I20260809 02:19:22.369989 13934 tablet_service.cc:1467] Processing CreateTablet for tablet 7ea0d4b1a2bf4c0cb303a17752f19dcb (DEFAULT_TABLE table=test-table [id=5abd77733fb647da81aca735f8dca1e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:22.369989 13635 tablet_service.cc:1467] Processing CreateTablet for tablet 7ea0d4b1a2bf4c0cb303a17752f19dcb (DEFAULT_TABLE table=test-table [id=5abd77733fb647da81aca735f8dca1e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:22.370105 13635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ea0d4b1a2bf4c0cb303a17752f19dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:22.370105 13934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ea0d4b1a2bf4c0cb303a17752f19dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:22.371083 13783 tablet_service.cc:1467] Processing CreateTablet for tablet 7ea0d4b1a2bf4c0cb303a17752f19dcb (DEFAULT_TABLE table=test-table [id=5abd77733fb647da81aca735f8dca1e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:22.371201 13783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ea0d4b1a2bf4c0cb303a17752f19dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:22.371291 14129 tablet_bootstrap.cc:492] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea: Bootstrap starting.
I20260809 02:19:22.371634 14129 tablet_bootstrap.cc:654] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:22.371949 14128 tablet_bootstrap.cc:492] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 6170c2330cd84de48c973e297cc3bb8a: Bootstrap starting.
I20260809 02:19:22.372263 14128 tablet_bootstrap.cc:654] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 6170c2330cd84de48c973e297cc3bb8a: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:22.372467 14127 tablet_bootstrap.cc:492] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P ef007ba8d18143b4983755af4d2b59c6: Bootstrap starting.
I20260809 02:19:22.372874 14127 tablet_bootstrap.cc:654] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P ef007ba8d18143b4983755af4d2b59c6: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:22.372922 14129 tablet_bootstrap.cc:492] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea: No bootstrap required, opened a new log
I20260809 02:19:22.372972 14129 ts_tablet_manager.cc:1397] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 02:19:22.373088 14129 raft_consensus.cc:348] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:22.373164 14129 raft_consensus.cc:374] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:22.373189 14129 raft_consensus.cc:729] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 954e3557e1b74bfb9040a2979f6242ea, State: Initialized, Role: FOLLOWER
I20260809 02:19:22.373239 14129 consensus_queue.cc:260] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:22.373332 14129 ts_tablet_manager.cc:1428] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:22.373695 14128 tablet_bootstrap.cc:492] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 6170c2330cd84de48c973e297cc3bb8a: No bootstrap required, opened a new log
I20260809 02:19:22.373747 14128 ts_tablet_manager.cc:1397] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 6170c2330cd84de48c973e297cc3bb8a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:19:22.373845 14127 tablet_bootstrap.cc:492] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P ef007ba8d18143b4983755af4d2b59c6: No bootstrap required, opened a new log
I20260809 02:19:22.373888 14127 ts_tablet_manager.cc:1397] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P ef007ba8d18143b4983755af4d2b59c6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:22.373853 14128 raft_consensus.cc:348] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:22.373930 14128 raft_consensus.cc:374] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:22.373960 14128 raft_consensus.cc:729] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6170c2330cd84de48c973e297cc3bb8a, State: Initialized, Role: FOLLOWER
I20260809 02:19:22.374003 14128 consensus_queue.cc:260] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 6170c2330cd84de48c973e297cc3bb8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:22.374029 14127 raft_consensus.cc:348] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:22.374085 14127 raft_consensus.cc:374] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:22.374089 14128 ts_tablet_manager.cc:1428] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 6170c2330cd84de48c973e297cc3bb8a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:22.374109 14127 raft_consensus.cc:729] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef007ba8d18143b4983755af4d2b59c6, State: Initialized, Role: FOLLOWER
I20260809 02:19:22.374150 14127 consensus_queue.cc:260] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P ef007ba8d18143b4983755af4d2b59c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:22.374241 14127 ts_tablet_manager.cc:1428] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P ef007ba8d18143b4983755af4d2b59c6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:22.702302 14102 raft_consensus.cc:482] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:19:22.702405 14102 raft_consensus.cc:504] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:22.702602 14102 leader_election.cc:288] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6170c2330cd84de48c973e297cc3bb8a (127.11.93.129:43721), ef007ba8d18143b4983755af4d2b59c6 (127.11.93.130:33799)
I20260809 02:19:22.702898 13803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ea0d4b1a2bf4c0cb303a17752f19dcb" candidate_uuid: "954e3557e1b74bfb9040a2979f6242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef007ba8d18143b4983755af4d2b59c6" is_pre_election: true
I20260809 02:19:22.702929 13656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ea0d4b1a2bf4c0cb303a17752f19dcb" candidate_uuid: "954e3557e1b74bfb9040a2979f6242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6170c2330cd84de48c973e297cc3bb8a" is_pre_election: true
I20260809 02:19:22.703047 13803 raft_consensus.cc:2454] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 954e3557e1b74bfb9040a2979f6242ea in term 0.
I20260809 02:19:22.703100 13656 raft_consensus.cc:2454] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 954e3557e1b74bfb9040a2979f6242ea in term 0.
I20260809 02:19:22.703238 13880 leader_election.cc:302] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 954e3557e1b74bfb9040a2979f6242ea, ef007ba8d18143b4983755af4d2b59c6; no voters:
I20260809 02:19:22.703358 14102 raft_consensus.cc:2781] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:19:22.703409 14102 raft_consensus.cc:482] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:19:22.703440 14102 raft_consensus.cc:3037] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:22.704267 14102 raft_consensus.cc:504] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:22.704411 14102 leader_election.cc:288] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea [CANDIDATE]: Term 1 election: Requested vote from peers 6170c2330cd84de48c973e297cc3bb8a (127.11.93.129:43721), ef007ba8d18143b4983755af4d2b59c6 (127.11.93.130:33799)
I20260809 02:19:22.704568 13656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ea0d4b1a2bf4c0cb303a17752f19dcb" candidate_uuid: "954e3557e1b74bfb9040a2979f6242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6170c2330cd84de48c973e297cc3bb8a"
I20260809 02:19:22.704641 13656 raft_consensus.cc:3037] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 6170c2330cd84de48c973e297cc3bb8a [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:22.704643 13803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ea0d4b1a2bf4c0cb303a17752f19dcb" candidate_uuid: "954e3557e1b74bfb9040a2979f6242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef007ba8d18143b4983755af4d2b59c6"
I20260809 02:19:22.704747 13803 raft_consensus.cc:3037] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P ef007ba8d18143b4983755af4d2b59c6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:22.705387 13656 raft_consensus.cc:2454] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 6170c2330cd84de48c973e297cc3bb8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 954e3557e1b74bfb9040a2979f6242ea in term 1.
I20260809 02:19:22.705470 13803 raft_consensus.cc:2454] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P ef007ba8d18143b4983755af4d2b59c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 954e3557e1b74bfb9040a2979f6242ea in term 1.
I20260809 02:19:22.705600 13877 leader_election.cc:302] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6170c2330cd84de48c973e297cc3bb8a, 954e3557e1b74bfb9040a2979f6242ea; no voters:
I20260809 02:19:22.705715 14102 raft_consensus.cc:2781] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:22.705786 14102 raft_consensus.cc:686] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea [term 1 LEADER]: Becoming Leader. State: Replica: 954e3557e1b74bfb9040a2979f6242ea, State: Running, Role: LEADER
I20260809 02:19:22.705821 14102 consensus_queue.cc:237] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } }
I20260809 02:19:22.706382 13482 catalog_manager.cc:5495] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 954e3557e1b74bfb9040a2979f6242ea (127.11.93.131). New cstate: current_term: 1 leader_uuid: "954e3557e1b74bfb9040a2979f6242ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "954e3557e1b74bfb9040a2979f6242ea" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 32957 } health_report { overall_health: HEALTHY } } }
I20260809 02:19:22.730000 14141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:22.728089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37278 (local address 127.11.93.131:32957)
0809 02:19:22.728138 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:22.728140 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:22.728152 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:19:22.728208 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:22.728209 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:22.728220 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:22.728260 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:19:22.728349 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:22.728804 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:22.729486 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:22.729660 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:22.729709 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:22.729816 (+ 107us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:19:22.729839 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:19:22.729870 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:22.729926 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 02:19:22.729943 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 02:19:22.734366 14147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:22.732126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:32957 (local address 127.11.93.131:46581)
0809 02:19:22.732183 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:22.732195 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:22.732245 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:22.732454 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:22.732454 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:22.732455 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:19:22.732497 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:22.732498 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:22.733087 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:22.733088 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:22.733610 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:22.733611 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:22.733971 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:22.733972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:22.734027 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:22.734032 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:19:22.734206 (+ 174us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:19:22.734208 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 02:19:22.734260 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 02:19:22.734308 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":4}
I20260809 02:19:22.734365 14141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:22.732287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:46581 (local address 127.11.93.131:32957)
0809 02:19:22.732347 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:22.732350 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:22.732355 (+ 5us) server_negotiation.cc:407] Connection header received
0809 02:19:22.732372 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:22.732372 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:22.732385 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:22.732452 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:19:22.732545 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:22.733003 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:22.733709 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:22.733889 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:22.733973 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:22.734111 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:19:22.734144 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:19:22.734204 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:22.734265 (+ 61us) server_negotiation.cc:299] Negotiation successful
0809 02:19:22.734289 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":21}
I20260809 02:19:22.736580 13803 raft_consensus.cc:1261] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P ef007ba8d18143b4983755af4d2b59c6 [term 1 FOLLOWER]: Refusing update from remote peer 954e3557e1b74bfb9040a2979f6242ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:22.736660 13656 raft_consensus.cc:1261] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 6170c2330cd84de48c973e297cc3bb8a [term 1 FOLLOWER]: Refusing update from remote peer 954e3557e1b74bfb9040a2979f6242ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:22.736842 14068 consensus_queue.cc:1035] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef007ba8d18143b4983755af4d2b59c6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:22.736990 14097 consensus_queue.cc:1035] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "6170c2330cd84de48c973e297cc3bb8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 02:19:22.741873 14095 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 02:19:24.265048 13484 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41714:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:24.265169 13484 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41714:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:24.266191 13484 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c5158e2a221f4d1aa4939ee876cdcd31: Sending DeleteTablet for 3 replicas of tablet 7ea0d4b1a2bf4c0cb303a17752f19dcb
I20260809 02:19:24.266471 13934 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ea0d4b1a2bf4c0cb303a17752f19dcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:24 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:37258
I20260809 02:19:24.266546 13635 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ea0d4b1a2bf4c0cb303a17752f19dcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:24 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:49658
I20260809 02:19:24.266750 14179 tablet_replica.cc:330] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea: stopping tablet replica
I20260809 02:19:24.266812 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 13563
I20260809 02:19:24.266834 14179 raft_consensus.cc:2229] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:19:24.267336 13783 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ea0d4b1a2bf4c0cb303a17752f19dcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:24 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:57824
I20260809 02:19:24.270910 14179 raft_consensus.cc:2258] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:24.271113 14181 tablet_replica.cc:330] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P ef007ba8d18143b4983755af4d2b59c6: stopping tablet replica
I20260809 02:19:24.271230 14181 raft_consensus.cc:2229] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P ef007ba8d18143b4983755af4d2b59c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:24.271301 14181 raft_consensus.cc:2258] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P ef007ba8d18143b4983755af4d2b59c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:24.271345 14179 ts_tablet_manager.cc:1905] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:24.271642 14181 ts_tablet_manager.cc:1905] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P ef007ba8d18143b4983755af4d2b59c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:24.273497 14181 ts_tablet_manager.cc:1918] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P ef007ba8d18143b4983755af4d2b59c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 02:19:24.273557 14179 ts_tablet_manager.cc:1918] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 02:19:24.273594 14181 log.cc:1196] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P ef007ba8d18143b4983755af4d2b59c6: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/7ea0d4b1a2bf4c0cb303a17752f19dcb
I20260809 02:19:24.273613 14179 log.cc:1196] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/7ea0d4b1a2bf4c0cb303a17752f19dcb
I20260809 02:19:24.273860 14179 ts_tablet_manager.cc:1939] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P 954e3557e1b74bfb9040a2979f6242ea: Deleting consensus metadata
I20260809 02:19:24.273876 14181 ts_tablet_manager.cc:1939] T 7ea0d4b1a2bf4c0cb303a17752f19dcb P ef007ba8d18143b4983755af4d2b59c6: Deleting consensus metadata
I20260809 02:19:24.274298 13468 catalog_manager.cc:4841] TS ef007ba8d18143b4983755af4d2b59c6 (127.11.93.130:33799): tablet 7ea0d4b1a2bf4c0cb303a17752f19dcb (table test-table [id=5abd77733fb647da81aca735f8dca1e9]) successfully deleted
I20260809 02:19:24.274483 13466 catalog_manager.cc:4841] TS 954e3557e1b74bfb9040a2979f6242ea (127.11.93.131:32957): tablet 7ea0d4b1a2bf4c0cb303a17752f19dcb (table test-table [id=5abd77733fb647da81aca735f8dca1e9]) successfully deleted
W20260809 02:19:24.278606 13465 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.93.129:43721 (error 108)
I20260809 02:19:24.278864 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 13713
I20260809 02:19:24.283175 14183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:24.279066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:43721 (local address 127.0.0.1:49674)
0809 02:19:24.283084 (+ 4018us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:24.283136 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.129:43721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3991,"thread_start_us":63,"threads_started":1}
W20260809 02:19:24.283342 13465 catalog_manager.cc:4584] TS 6170c2330cd84de48c973e297cc3bb8a (127.11.93.129:43721): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7ea0d4b1a2bf4c0cb303a17752f19dcb: Network error: Client connection negotiation failed: client connection to 127.11.93.129:43721: connect: Connection refused (error 111)
I20260809 02:19:24.287218 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 13861
I20260809 02:19:24.293720 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 13446
2026-08-09T02:19:24Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6301 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:19:24 dist-test-slave-w206 krb5kdc[14186](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:19:24 dist-test-slave-w206 krb5kdc[14186](info): set up 2 sockets
Aug 09 02:19:24 dist-test-slave-w206 krb5kdc[14186](info): commencing operation
krb5kdc: starting...
W20260809 02:19:25.373955 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.057s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:19:25 dist-test-slave-w206 krb5kdc[14186](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241965, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:19:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:19:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:19:25.499521 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:45517
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:37399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:45517
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:25.581106 14200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:25.581312 14200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:25.581336 14200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:25.582432 14200 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:19:25.582474 14200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:25.582489 14200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:25.582500 14200 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:19:25.582513 14200 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:19:25.583940 14200 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:37399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:45517
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:45517
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:25.584132 14200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:25.584302 14200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:25.589802 14205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:25.589828 14206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:25.589862 14200 server_base.cc:1034] running on GCE node
W20260809 02:19:25.590010 14209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:25.590389 14200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:25.590744 14200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:25.591895 14200 hybrid_clock.cc:648] HybridClock initialized: now 1786241965591869 us; error 37 us; skew 500 ppm
Aug 09 02:19:25 dist-test-slave-w206 krb5kdc[14186](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241965, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:25.594820 14200 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:19:25.595335 14200 webserver.cc:460] Webserver started at http://127.11.93.190:37579/ using document root <none> and password file <none>
I20260809 02:19:25.595592 14200 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:25.595642 14200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:25.595836 14200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:25.596999 14200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "e090e189327147e5952d093622594409"
format_stamp: "Formatted at 2026-08-09 02:19:25 on dist-test-slave-w206"
server_key: "22b7073797c7568930ab5475513bc5a1"
server_key_iv: "3816ee57b7daebdab74ae97795faad3a"
server_key_version: "encryptionkey@0"
I20260809 02:19:25.597420 14200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "e090e189327147e5952d093622594409"
format_stamp: "Formatted at 2026-08-09 02:19:25 on dist-test-slave-w206"
server_key: "22b7073797c7568930ab5475513bc5a1"
server_key_iv: "3816ee57b7daebdab74ae97795faad3a"
server_key_version: "encryptionkey@0"
I20260809 02:19:25.598907 14200 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:19:25.599752 14216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:25.599977 14200 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:25.600076 14200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "e090e189327147e5952d093622594409"
format_stamp: "Formatted at 2026-08-09 02:19:25 on dist-test-slave-w206"
server_key: "22b7073797c7568930ab5475513bc5a1"
server_key_iv: "3816ee57b7daebdab74ae97795faad3a"
server_key_version: "encryptionkey@0"
I20260809 02:19:25.600137 14200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:25.610661 14200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:25.613046 14200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:25.613162 14200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:25.617173 14200 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:45517
I20260809 02:19:25.617264 14271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:45517 every 8 connection(s)
I20260809 02:19:25.617594 14200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:19:25.618605 14272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:25.621143 14272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409: Bootstrap starting.
I20260809 02:19:25.621785 14272 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:25.622100 14272 log.cc:824] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:25.623024 14272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409: No bootstrap required, opened a new log
I20260809 02:19:25.624559 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 14200
I20260809 02:19:25.624656 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:19:25.624840 11638 external_mini_cluster.cc:1428] Setting key 089d2d1dbded7ca31a817e5f7b11ef8b
I20260809 02:19:25.625473 14272 raft_consensus.cc:348] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e090e189327147e5952d093622594409" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45517 } }
I20260809 02:19:25.625674 14272 raft_consensus.cc:374] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:25.625733 14272 raft_consensus.cc:729] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e090e189327147e5952d093622594409, State: Initialized, Role: FOLLOWER
I20260809 02:19:25.625862 14272 consensus_queue.cc:260] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e090e189327147e5952d093622594409" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45517 } }
I20260809 02:19:25.625954 14272 raft_consensus.cc:388] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:19:25.626001 14272 raft_consensus.cc:482] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:19:25.626087 14272 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:25.627250 14272 raft_consensus.cc:504] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e090e189327147e5952d093622594409" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45517 } }
I20260809 02:19:25.627337 14272 leader_election.cc:302] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e090e189327147e5952d093622594409; no voters:
I20260809 02:19:25.627547 14272 leader_election.cc:288] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:19:25.627573 14277 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:25.627748 14277 raft_consensus.cc:686] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409 [term 1 LEADER]: Becoming Leader. State: Replica: e090e189327147e5952d093622594409, State: Running, Role: LEADER
I20260809 02:19:25.627951 14272 sys_catalog.cc:564] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:19:25.627915 14277 consensus_queue.cc:237] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e090e189327147e5952d093622594409" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45517 } }
I20260809 02:19:25.628351 14277 sys_catalog.cc:455] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e090e189327147e5952d093622594409. Latest consensus state: current_term: 1 leader_uuid: "e090e189327147e5952d093622594409" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e090e189327147e5952d093622594409" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45517 } } }
I20260809 02:19:25.628566 14277 sys_catalog.cc:458] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409 [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:25.628494 14278 sys_catalog.cc:455] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e090e189327147e5952d093622594409" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e090e189327147e5952d093622594409" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45517 } } }
I20260809 02:19:25.628764 14278 sys_catalog.cc:458] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409 [sys.catalog]: This master's current role is: LEADER
W20260809 02:19:25.629717 14294 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:19:25.629814 14294 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:19:25.629925 14287 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:19:25.630086 14287 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:19:25.631628 14287 catalog_manager.cc:1347] Generated new cluster ID: e97ea0a3c3b04299a6549ea06cceb170
I20260809 02:19:25.631683 14287 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 02:19:25 dist-test-slave-w206 krb5kdc[14186](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241965, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:25.636757 14276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:25.625388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56846 (local address 127.11.93.190:45517)
0809 02:19:25.625579 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:25.625588 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:25.625623 (+ 35us) server_negotiation.cc:407] Connection header received
0809 02:19:25.625741 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:25.625749 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:25.625807 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:25.625967 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:25.626770 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:25.628000 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:25.629173 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:25.629787 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:25.629913 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:25.632814 (+ 2901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:25.632818 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:25.632818 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:25.632829 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:25.634821 (+ 1992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:25.635232 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:25.635236 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:25.635236 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:25.635360 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:25.635546 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:25.635547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:25.635547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:25.635820 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:25.635958 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:25.636432 (+ 474us) server_negotiation.cc:299] Negotiation successful
0809 02:19:25.636563 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":111,"threads_started":1}
I20260809 02:19:25.640213 14287 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:19:25.640687 14287 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:19:25.645872 14287 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e090e189327147e5952d093622594409: Generated new TSK 0
I20260809 02:19:25.646057 14287 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.93.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
I20260809 02:19:25.677934 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:45517
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:37399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:25.760515 14300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:25.760751 14300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:25.760787 14300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:25.761929 14300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:25.761992 14300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:25.762036 14300 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:19:25.763526 14300 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:37399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:45517
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14300
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:25.763799 14300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:25.764032 14300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:25.769177 14306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:25.769209 14309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:25.769198 14307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:25.769646 14300 server_base.cc:1034] running on GCE node
I20260809 02:19:25.769874 14300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:25.770109 14300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:25.771380 14300 hybrid_clock.cc:648] HybridClock initialized: now 1786241965771370 us; error 50 us; skew 500 ppm
Aug 09 02:19:25 dist-test-slave-w206 krb5kdc[14186](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241965, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:25.773921 14300 init.cc:377] Logged in from keytab as kudu/127.11.93.129@KRBTEST.COM (short username kudu)
I20260809 02:19:25.774343 14300 webserver.cc:460] Webserver started at http://127.11.93.129:45465/ using document root <none> and password file <none>
I20260809 02:19:25.774595 14300 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:25.774664 14300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:25.774812 14300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:25.775906 14300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "f236f37caf1e461b954e44651619eca4"
format_stamp: "Formatted at 2026-08-09 02:19:25 on dist-test-slave-w206"
server_key: "343c3dbbd7098163f0d2afe850ef8a17"
server_key_iv: "ba26b7f2e2c70d6e4284030007013eff"
server_key_version: "encryptionkey@0"
I20260809 02:19:25.776268 14300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "f236f37caf1e461b954e44651619eca4"
format_stamp: "Formatted at 2026-08-09 02:19:25 on dist-test-slave-w206"
server_key: "343c3dbbd7098163f0d2afe850ef8a17"
server_key_iv: "ba26b7f2e2c70d6e4284030007013eff"
server_key_version: "encryptionkey@0"
I20260809 02:19:25.777585 14300 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:19:25.778304 14316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:25.778486 14300 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:19:25.778584 14300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "f236f37caf1e461b954e44651619eca4"
format_stamp: "Formatted at 2026-08-09 02:19:25 on dist-test-slave-w206"
server_key: "343c3dbbd7098163f0d2afe850ef8a17"
server_key_iv: "ba26b7f2e2c70d6e4284030007013eff"
server_key_version: "encryptionkey@0"
I20260809 02:19:25.778666 14300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:25.800673 14300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:25.802731 14300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:25.802899 14300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:25.803169 14300 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:25.803519 14300 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:25.803575 14300 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:25.803615 14300 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:25.803663 14300 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:25.809528 14300 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:37469
I20260809 02:19:25.809577 14432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:37469 every 8 connection(s)
I20260809 02:19:25.809890 14300 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:19:25.813688 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 14300
I20260809 02:19:25.813764 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:19:25.813969 11638 external_mini_cluster.cc:1428] Setting key 1e161791fd23ab49daf885c27ac5a03d
Aug 09 02:19:25 dist-test-slave-w206 krb5kdc[14186](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241965, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:25.820050 14276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:25.810604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:46303 (local address 127.11.93.190:45517)
0809 02:19:25.810657 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:25.810660 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:25.810867 (+ 207us) server_negotiation.cc:407] Connection header received
0809 02:19:25.811438 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:25.811440 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:25.811454 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:25.811518 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:25.812469 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:25.812989 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:25.814145 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:25.814429 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:25.814512 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:25.816966 (+ 2454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:25.816968 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:25.816969 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:25.816979 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:25.818452 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:25.819018 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:25.819020 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:25.819020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:25.819086 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:25.819395 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:25.819396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:25.819396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:25.819501 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:25.819552 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:25.819918 (+ 366us) server_negotiation.cc:299] Negotiation successful
0809 02:19:25.819987 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 02:19:25.820384 14435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:25.810561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45517 (local address 127.11.93.129:46303)
0809 02:19:25.810719 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:25.810776 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:25.811320 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:25.811590 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:25.811594 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:25.812170 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:25.812359 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:25.812364 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:25.813085 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:25.813087 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:25.813992 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:25.814013 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:25.814570 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:25.814571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:25.814697 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:25.815297 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:25.815305 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:25.816849 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:25.818543 (+ 1694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:25.818552 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:25.818554 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:25.818897 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:25.819160 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:25.819161 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:25.819161 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:25.819314 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:25.819573 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:25.819580 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:25.819756 (+ 176us) client_negotiation.cc:769] Sending connection context
0809 02:19:25.819888 (+ 132us) client_negotiation.cc:240] Negotiation successful
0809 02:19:25.820092 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":71,"threads_started":1}
I20260809 02:19:25.820974 14433 heartbeater.cc:347] Connected to a master server at 127.11.93.190:45517
I20260809 02:19:25.821094 14433 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:25.821280 14433 heartbeater.cc:511] Master 127.11.93.190:45517 requested a full tablet report, sending...
I20260809 02:19:25.821827 14234 ts_manager.cc:194] Registered new tserver with Master: f236f37caf1e461b954e44651619eca4 (127.11.93.129:37469)
I20260809 02:19:25.822451 14234 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:46303
WARNING: no policy specified for kudu/127.11.93.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
I20260809 02:19:25.841297 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:45517
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:37399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:25.922550 14440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:25.922798 14440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:25.922839 14440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:25.924063 14440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:25.924132 14440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:25.924178 14440 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:19:25.925606 14440 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:37399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:45517
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14440
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:25.925865 14440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:25.926102 14440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:25.931382 14447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:25.931360 14451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:25.931361 14448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:25.931751 14440 server_base.cc:1034] running on GCE node
I20260809 02:19:25.931959 14440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:25.932197 14440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:25.933372 14440 hybrid_clock.cc:648] HybridClock initialized: now 1786241965933357 us; error 25 us; skew 500 ppm
Aug 09 02:19:25 dist-test-slave-w206 krb5kdc[14186](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241965, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:25.940101 14440 init.cc:377] Logged in from keytab as kudu/127.11.93.130@KRBTEST.COM (short username kudu)
I20260809 02:19:25.940622 14440 webserver.cc:460] Webserver started at http://127.11.93.130:43023/ using document root <none> and password file <none>
I20260809 02:19:25.940852 14440 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:25.940922 14440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:25.941080 14440 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:25.942130 14440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "94af591ad5e44233abb679ebb269c905"
format_stamp: "Formatted at 2026-08-09 02:19:25 on dist-test-slave-w206"
server_key: "85138aa961fd3b5913c3563cc0054d11"
server_key_iv: "5f54b38c5b0baa3c040de9a32506c71f"
server_key_version: "encryptionkey@0"
I20260809 02:19:25.942631 14440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "94af591ad5e44233abb679ebb269c905"
format_stamp: "Formatted at 2026-08-09 02:19:25 on dist-test-slave-w206"
server_key: "85138aa961fd3b5913c3563cc0054d11"
server_key_iv: "5f54b38c5b0baa3c040de9a32506c71f"
server_key_version: "encryptionkey@0"
I20260809 02:19:25.944149 14440 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:19:25.944922 14458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:25.945109 14440 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:25.945214 14440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "94af591ad5e44233abb679ebb269c905"
format_stamp: "Formatted at 2026-08-09 02:19:25 on dist-test-slave-w206"
server_key: "85138aa961fd3b5913c3563cc0054d11"
server_key_iv: "5f54b38c5b0baa3c040de9a32506c71f"
server_key_version: "encryptionkey@0"
I20260809 02:19:25.945312 14440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:25.959556 14440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:25.961390 14440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:25.961562 14440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:25.961802 14440 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:25.962113 14440 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:25.962168 14440 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:25.962201 14440 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:25.962231 14440 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:25.968335 14440 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:36779
I20260809 02:19:25.968381 14579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:36779 every 8 connection(s)
I20260809 02:19:25.968693 14440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
Aug 09 02:19:25 dist-test-slave-w206 krb5kdc[14186](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241965, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:25.976579 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 14440
I20260809 02:19:25.976657 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:19:25.976910 11638 external_mini_cluster.cc:1428] Setting key af39a0834bd7117339e97c16ea2f673b
I20260809 02:19:25.978368 14582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:25.969402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45517 (local address 127.11.93.130:51691)
0809 02:19:25.969618 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:25.969654 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:25.970238 (+ 584us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:25.970514 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:25.970517 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:25.971123 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:25.971317 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:25.971322 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:25.972039 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:25.972040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:25.972827 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:25.972829 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:25.973254 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:25.973256 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:25.973382 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:25.973920 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:25.973929 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:25.975283 (+ 1354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:25.976768 (+ 1485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:25.976776 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:25.976778 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:25.977101 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:25.977382 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:25.977383 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:25.977384 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:25.977504 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:25.977840 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:25.977846 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:25.977980 (+ 134us) client_negotiation.cc:769] Sending connection context
0809 02:19:25.978073 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 02:19:25.978210 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":115,"threads_started":1}
I20260809 02:19:25.978430 14276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:25.969437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:51691 (local address 127.11.93.190:45517)
0809 02:19:25.969511 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:25.969514 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:25.969775 (+ 261us) server_negotiation.cc:407] Connection header received
0809 02:19:25.970351 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:25.970353 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:25.970366 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:25.970438 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:25.971431 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:25.971940 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:25.972942 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:25.973140 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:25.973245 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:25.975403 (+ 2158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:25.975404 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:25.975405 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:25.975412 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:25.976612 (+ 1200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:25.977203 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:25.977204 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:25.977205 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:25.977288 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:25.977580 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:25.977582 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:25.977582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:25.977764 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:25.977852 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:25.978124 (+ 272us) server_negotiation.cc:299] Negotiation successful
0809 02:19:25.978270 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:19:25.978878 14580 heartbeater.cc:347] Connected to a master server at 127.11.93.190:45517
I20260809 02:19:25.978965 14580 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:25.979185 14580 heartbeater.cc:511] Master 127.11.93.190:45517 requested a full tablet report, sending...
I20260809 02:19:25.979602 14234 ts_manager.cc:194] Registered new tserver with Master: 94af591ad5e44233abb679ebb269c905 (127.11.93.130:36779)
I20260809 02:19:25.980080 14234 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:51691
WARNING: no policy specified for kudu/127.11.93.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
I20260809 02:19:26.004168 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:45517
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:37399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:26.087863 14585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:26.088120 14585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:26.088157 14585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:26.089345 14585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:26.089416 14585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:26.089461 14585 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:19:26.090939 14585 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:37399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:45517
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14585
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:26.091233 14585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:26.091467 14585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:26.096459 14591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:26.096477 14590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:26.096455 14593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:26.096743 14585 server_base.cc:1034] running on GCE node
I20260809 02:19:26.097013 14585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:26.097270 14585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:26.098430 14585 hybrid_clock.cc:648] HybridClock initialized: now 1786241966098425 us; error 37 us; skew 500 ppm
Aug 09 02:19:26 dist-test-slave-w206 krb5kdc[14186](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241966, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:26.101183 14585 init.cc:377] Logged in from keytab as kudu/127.11.93.131@KRBTEST.COM (short username kudu)
I20260809 02:19:26.101576 14585 webserver.cc:460] Webserver started at http://127.11.93.131:44487/ using document root <none> and password file <none>
I20260809 02:19:26.101781 14585 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:26.101822 14585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:26.101922 14585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:26.102959 14585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "9f4fea2e47544510a1b8555d22b78453"
format_stamp: "Formatted at 2026-08-09 02:19:26 on dist-test-slave-w206"
server_key: "1142699769d544968f684e955080743b"
server_key_iv: "26c69931ec584b44cd2ce1875eaeca94"
server_key_version: "encryptionkey@0"
I20260809 02:19:26.103338 14585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "9f4fea2e47544510a1b8555d22b78453"
format_stamp: "Formatted at 2026-08-09 02:19:26 on dist-test-slave-w206"
server_key: "1142699769d544968f684e955080743b"
server_key_iv: "26c69931ec584b44cd2ce1875eaeca94"
server_key_version: "encryptionkey@0"
I20260809 02:19:26.104710 14585 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:19:26.105454 14600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:26.105628 14585 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:26.105715 14585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "9f4fea2e47544510a1b8555d22b78453"
format_stamp: "Formatted at 2026-08-09 02:19:26 on dist-test-slave-w206"
server_key: "1142699769d544968f684e955080743b"
server_key_iv: "26c69931ec584b44cd2ce1875eaeca94"
server_key_version: "encryptionkey@0"
I20260809 02:19:26.105767 14585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:26.114763 14585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:26.116643 14585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:26.116757 14585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:26.116941 14585 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:26.117269 14585 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:26.117305 14585 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:26.117360 14585 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:26.117401 14585 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:26.123253 14585 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:34401
I20260809 02:19:26.123327 14721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:34401 every 8 connection(s)
I20260809 02:19:26.123654 14585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
Aug 09 02:19:26 dist-test-slave-w206 krb5kdc[14186](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241966, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:26.129956 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 14585
I20260809 02:19:26.130080 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:19:26.130280 11638 external_mini_cluster.cc:1428] Setting key 3b6843bd43ff6ebca54264bf7aaa5e11
I20260809 02:19:26.133159 14276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:26.124372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:51857 (local address 127.11.93.190:45517)
0809 02:19:26.124456 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:26.124459 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:26.124649 (+ 190us) server_negotiation.cc:407] Connection header received
0809 02:19:26.125134 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:26.125136 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:26.125146 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:26.125198 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:26.126093 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:26.126584 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:26.127667 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:26.127890 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:26.127967 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:26.130344 (+ 2377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:26.130346 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:26.130346 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:26.130356 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:26.131955 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:26.132335 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:26.132336 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:26.132336 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:26.132408 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:26.132623 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:26.132624 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:26.132624 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:26.132729 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:26.132780 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:26.133024 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 02:19:26.133093 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 02:19:26.133320 14725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:26.124324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45517 (local address 127.11.93.131:51857)
0809 02:19:26.124521 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:26.124557 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:26.125047 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:26.125251 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:26.125254 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:26.125816 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:26.126018 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:26.126022 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:26.126661 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:26.126661 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:26.127559 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:26.127561 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:26.127976 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:26.127977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:26.128117 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:26.128709 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:26.128718 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:26.130252 (+ 1534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:26.132032 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:26.132038 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:26.132040 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:26.132266 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:26.132469 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:26.132469 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:26.132470 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:26.132568 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:26.132785 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:26.132789 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:26.132911 (+ 122us) client_negotiation.cc:769] Sending connection context
0809 02:19:26.132994 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 02:19:26.133117 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":123,"threads_started":1}
I20260809 02:19:26.133757 14722 heartbeater.cc:347] Connected to a master server at 127.11.93.190:45517
I20260809 02:19:26.133874 14722 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:26.134063 14722 heartbeater.cc:511] Master 127.11.93.190:45517 requested a full tablet report, sending...
I20260809 02:19:26.134429 14234 ts_manager.cc:194] Registered new tserver with Master: 9f4fea2e47544510a1b8555d22b78453 (127.11.93.131:34401)
I20260809 02:19:26.134766 14234 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:51857
I20260809 02:19:26.142272 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 02:19:26.156601 14276 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:26.155494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36652 (local address 127.11.93.190:45517)
0809 02:19:26.155565 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:26.155567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:26.155712 (+ 145us) server_negotiation.cc:407] Connection header received
0809 02:19:26.155748 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:26.155749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:26.155761 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:26.155845 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:26.156478 (+ 633us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36652: BlockingRecv error: recv got EOF from 127.0.0.1:36652 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 02:19:26.157510 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 14300
I20260809 02:19:26.163499 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 14440
I20260809 02:19:26.170691 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 14585
I20260809 02:19:26.177111 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 14200
2026-08-09T02:19:26Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1882 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:19:26 dist-test-slave-w206 krb5kdc[14737](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:19:26 dist-test-slave-w206 krb5kdc[14737](info): set up 2 sockets
Aug 09 02:19:26 dist-test-slave-w206 krb5kdc[14737](info): commencing operation
krb5kdc: starting...
W20260809 02:19:27.270081 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:19:27 dist-test-slave-w206 krb5kdc[14737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241967, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:19:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:19:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:19:27.393487 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:41615
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:43159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:41615
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:27.479817 14750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:27.480074 14750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:27.480114 14750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:27.481374 14750 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:19:27.481438 14750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:27.481462 14750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:27.481485 14750 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:19:27.481513 14750 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:19:27.482967 14750 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:43159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:41615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:41615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14750
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:27.483250 14750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:27.483476 14750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:27.488440 14758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:27.488473 14755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:27.488476 14756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:27.488786 14750 server_base.cc:1034] running on GCE node
I20260809 02:19:27.489023 14750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:27.489310 14750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:27.490450 14750 hybrid_clock.cc:648] HybridClock initialized: now 1786241967490440 us; error 29 us; skew 500 ppm
Aug 09 02:19:27 dist-test-slave-w206 krb5kdc[14737](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241967, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:27.493069 14750 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:19:27.493530 14750 webserver.cc:460] Webserver started at http://127.11.93.190:44021/ using document root <none> and password file <none>
I20260809 02:19:27.493762 14750 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:27.493809 14750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:27.493942 14750 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:27.495092 14750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "e0df6a7a56e34d2d82fd05d8bf0fef49"
format_stamp: "Formatted at 2026-08-09 02:19:27 on dist-test-slave-w206"
server_key: "0f431ee2712bb3aa09aa89c8af3388bc"
server_key_iv: "09b9df5dfb38f6c8da07cf60b42a4162"
server_key_version: "encryptionkey@0"
I20260809 02:19:27.495466 14750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "e0df6a7a56e34d2d82fd05d8bf0fef49"
format_stamp: "Formatted at 2026-08-09 02:19:27 on dist-test-slave-w206"
server_key: "0f431ee2712bb3aa09aa89c8af3388bc"
server_key_iv: "09b9df5dfb38f6c8da07cf60b42a4162"
server_key_version: "encryptionkey@0"
I20260809 02:19:27.496825 14750 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:19:27.497577 14767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:27.497766 14750 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:19:27.497860 14750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "e0df6a7a56e34d2d82fd05d8bf0fef49"
format_stamp: "Formatted at 2026-08-09 02:19:27 on dist-test-slave-w206"
server_key: "0f431ee2712bb3aa09aa89c8af3388bc"
server_key_iv: "09b9df5dfb38f6c8da07cf60b42a4162"
server_key_version: "encryptionkey@0"
I20260809 02:19:27.497941 14750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:27.521697 14750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:27.524245 14750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:27.524426 14750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:27.528754 14750 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:41615
I20260809 02:19:27.528870 14826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:41615 every 8 connection(s)
I20260809 02:19:27.529351 14750 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:19:27.530063 14827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:27.532652 14827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0df6a7a56e34d2d82fd05d8bf0fef49: Bootstrap starting.
I20260809 02:19:27.533332 14827 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e0df6a7a56e34d2d82fd05d8bf0fef49: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:27.533644 14827 log.cc:824] T 00000000000000000000000000000000 P e0df6a7a56e34d2d82fd05d8bf0fef49: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:27.534358 14827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0df6a7a56e34d2d82fd05d8bf0fef49: No bootstrap required, opened a new log
I20260809 02:19:27.536003 14827 raft_consensus.cc:348] T 00000000000000000000000000000000 P e0df6a7a56e34d2d82fd05d8bf0fef49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0df6a7a56e34d2d82fd05d8bf0fef49" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41615 } }
I20260809 02:19:27.536145 14827 raft_consensus.cc:374] T 00000000000000000000000000000000 P e0df6a7a56e34d2d82fd05d8bf0fef49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:27.536168 14827 raft_consensus.cc:729] T 00000000000000000000000000000000 P e0df6a7a56e34d2d82fd05d8bf0fef49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0df6a7a56e34d2d82fd05d8bf0fef49, State: Initialized, Role: FOLLOWER
I20260809 02:19:27.536326 14827 consensus_queue.cc:260] T 00000000000000000000000000000000 P e0df6a7a56e34d2d82fd05d8bf0fef49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0df6a7a56e34d2d82fd05d8bf0fef49" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41615 } }
I20260809 02:19:27.536406 14827 raft_consensus.cc:388] T 00000000000000000000000000000000 P e0df6a7a56e34d2d82fd05d8bf0fef49 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:19:27.536439 14827 raft_consensus.cc:482] T 00000000000000000000000000000000 P e0df6a7a56e34d2d82fd05d8bf0fef49 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:19:27.536505 14827 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e0df6a7a56e34d2d82fd05d8bf0fef49 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:27.537422 14827 raft_consensus.cc:504] T 00000000000000000000000000000000 P e0df6a7a56e34d2d82fd05d8bf0fef49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0df6a7a56e34d2d82fd05d8bf0fef49" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41615 } }
I20260809 02:19:27.537518 14827 leader_election.cc:302] T 00000000000000000000000000000000 P e0df6a7a56e34d2d82fd05d8bf0fef49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e0df6a7a56e34d2d82fd05d8bf0fef49; no voters:
I20260809 02:19:27.537700 14827 leader_election.cc:288] T 00000000000000000000000000000000 P e0df6a7a56e34d2d82fd05d8bf0fef49 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:19:27.537757 14831 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e0df6a7a56e34d2d82fd05d8bf0fef49 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:27.537986 14827 sys_catalog.cc:564] T 00000000000000000000000000000000 P e0df6a7a56e34d2d82fd05d8bf0fef49 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:19:27.537994 14831 raft_consensus.cc:686] T 00000000000000000000000000000000 P e0df6a7a56e34d2d82fd05d8bf0fef49 [term 1 LEADER]: Becoming Leader. State: Replica: e0df6a7a56e34d2d82fd05d8bf0fef49, State: Running, Role: LEADER
I20260809 02:19:27.538105 14831 consensus_queue.cc:237] T 00000000000000000000000000000000 P e0df6a7a56e34d2d82fd05d8bf0fef49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0df6a7a56e34d2d82fd05d8bf0fef49" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41615 } }
I20260809 02:19:27.538558 14832 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0df6a7a56e34d2d82fd05d8bf0fef49 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e0df6a7a56e34d2d82fd05d8bf0fef49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0df6a7a56e34d2d82fd05d8bf0fef49" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41615 } } }
I20260809 02:19:27.538570 14833 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0df6a7a56e34d2d82fd05d8bf0fef49 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e0df6a7a56e34d2d82fd05d8bf0fef49. Latest consensus state: current_term: 1 leader_uuid: "e0df6a7a56e34d2d82fd05d8bf0fef49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0df6a7a56e34d2d82fd05d8bf0fef49" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41615 } } }
I20260809 02:19:27.538674 14832 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0df6a7a56e34d2d82fd05d8bf0fef49 [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:27.538678 14833 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0df6a7a56e34d2d82fd05d8bf0fef49 [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:27.539096 14840 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:19:27.539131 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 14750
I20260809 02:19:27.539214 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:19:27.539413 11638 external_mini_cluster.cc:1428] Setting key 256934c85b0199802380a3e28519a296
I20260809 02:19:27.539640 14840 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:19:27.541333 14840 catalog_manager.cc:1347] Generated new cluster ID: 56769a38fedc4ecc9a24d827bfa1a112
I20260809 02:19:27.541419 14840 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 02:19:27 dist-test-slave-w206 krb5kdc[14737](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241967, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:27.553287 14850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:27.540068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58560 (local address 127.11.93.190:41615)
0809 02:19:27.540278 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:27.540288 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:27.540479 (+ 191us) server_negotiation.cc:407] Connection header received
0809 02:19:27.540598 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:27.540605 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:27.540676 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:27.540817 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:27.543449 (+ 2632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:27.544934 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:27.545992 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:27.546663 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:27.546780 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:27.549619 (+ 2839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:27.549623 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:27.549623 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:27.549649 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:27.551644 (+ 1995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:27.552057 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:27.552060 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:27.552060 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:27.552166 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:27.552375 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:27.552376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:27.552376 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:27.552670 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:27.552791 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:27.552922 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 02:19:27.553054 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":84,"threads_started":1}
I20260809 02:19:27.554243 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:19:27.562331 14840 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:19:27.563212 14840 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:19:27.570314 14840 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e0df6a7a56e34d2d82fd05d8bf0fef49: Generated new TSK 0
I20260809 02:19:27.570575 14840 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:19:27.571945 14850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:27.567878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58568 (local address 127.11.93.190:41615)
0809 02:19:27.567924 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:27.567926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:27.567935 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:19:27.568011 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:27.568012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:27.568021 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:27.568078 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:27.568534 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:27.569290 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:27.570416 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:27.570720 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:27.570787 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:27.571501 (+ 714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:27.571502 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:27.571503 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:19:27.571675 (+ 172us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:27.571691 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:19:27.571698 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:27.571744 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:27.571832 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 02:19:27.571854 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 02:19:27.574498 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 14750
2026-08-09T02:19:27Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1395 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:19:27 dist-test-slave-w206 krb5kdc[14861](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:19:27 dist-test-slave-w206 krb5kdc[14861](info): set up 2 sockets
Aug 09 02:19:27 dist-test-slave-w206 krb5kdc[14861](info): commencing operation
krb5kdc: starting...
W20260809 02:19:28.655175 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.061s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:19:28 dist-test-slave-w206 krb5kdc[14861](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241968, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:19:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:19:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:19:28.779520 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:43719
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:40349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:43719
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:28.861726 14874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:28.861933 14874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:28.861956 14874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:28.863133 14874 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:19:28.863175 14874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:28.863190 14874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:28.863204 14874 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:19:28.863215 14874 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:19:28.864758 14874 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:40349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:43719
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:43719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14874
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:28.865012 14874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:28.865254 14874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:28.870074 14879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:28.870090 14880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:28.870090 14882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:28.870368 14874 server_base.cc:1034] running on GCE node
I20260809 02:19:28.870625 14874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:28.870908 14874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:28.872078 14874 hybrid_clock.cc:648] HybridClock initialized: now 1786241968872076 us; error 57 us; skew 500 ppm
Aug 09 02:19:28 dist-test-slave-w206 krb5kdc[14861](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241968, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:28.874749 14874 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:19:28.875306 14874 webserver.cc:460] Webserver started at http://127.11.93.190:35477/ using document root <none> and password file <none>
I20260809 02:19:28.875559 14874 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:28.875628 14874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:28.875784 14874 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:28.876853 14874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "23303da095fc456db7953ebcefd65d6f"
format_stamp: "Formatted at 2026-08-09 02:19:28 on dist-test-slave-w206"
server_key: "7d9cc5ec187fc54919fc012dd4474ad2"
server_key_iv: "2139aa42e9bae6234268a88b689e8631"
server_key_version: "encryptionkey@0"
I20260809 02:19:28.877234 14874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "23303da095fc456db7953ebcefd65d6f"
format_stamp: "Formatted at 2026-08-09 02:19:28 on dist-test-slave-w206"
server_key: "7d9cc5ec187fc54919fc012dd4474ad2"
server_key_iv: "2139aa42e9bae6234268a88b689e8631"
server_key_version: "encryptionkey@0"
I20260809 02:19:28.878571 14874 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:19:28.879388 14891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:28.879566 14874 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 02:19:28.879662 14874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "23303da095fc456db7953ebcefd65d6f"
format_stamp: "Formatted at 2026-08-09 02:19:28 on dist-test-slave-w206"
server_key: "7d9cc5ec187fc54919fc012dd4474ad2"
server_key_iv: "2139aa42e9bae6234268a88b689e8631"
server_key_version: "encryptionkey@0"
I20260809 02:19:28.879743 14874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:28.892249 14874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:28.894058 14874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:28.894217 14874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:28.898105 14874 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:43719
I20260809 02:19:28.898154 14949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:43719 every 8 connection(s)
I20260809 02:19:28.898509 14874 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:19:28.899627 14950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:28.901945 14950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23303da095fc456db7953ebcefd65d6f: Bootstrap starting.
I20260809 02:19:28.902523 14950 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23303da095fc456db7953ebcefd65d6f: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:28.902817 14950 log.cc:824] T 00000000000000000000000000000000 P 23303da095fc456db7953ebcefd65d6f: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:28.903587 14950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23303da095fc456db7953ebcefd65d6f: No bootstrap required, opened a new log
I20260809 02:19:28.904551 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 14874
I20260809 02:19:28.904663 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:19:28.904857 11638 external_mini_cluster.cc:1428] Setting key 57b6efc63255ef6333d62b07fe6d60f8
I20260809 02:19:28.905753 14950 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23303da095fc456db7953ebcefd65d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23303da095fc456db7953ebcefd65d6f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 43719 } }
I20260809 02:19:28.905920 14950 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23303da095fc456db7953ebcefd65d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:28.905962 14950 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23303da095fc456db7953ebcefd65d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23303da095fc456db7953ebcefd65d6f, State: Initialized, Role: FOLLOWER
I20260809 02:19:28.906152 14950 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23303da095fc456db7953ebcefd65d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23303da095fc456db7953ebcefd65d6f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 43719 } }
I20260809 02:19:28.906248 14950 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23303da095fc456db7953ebcefd65d6f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:19:28.906281 14950 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23303da095fc456db7953ebcefd65d6f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:19:28.906327 14950 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23303da095fc456db7953ebcefd65d6f [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:28.907341 14950 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23303da095fc456db7953ebcefd65d6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23303da095fc456db7953ebcefd65d6f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 43719 } }
I20260809 02:19:28.907475 14950 leader_election.cc:302] T 00000000000000000000000000000000 P 23303da095fc456db7953ebcefd65d6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23303da095fc456db7953ebcefd65d6f; no voters:
I20260809 02:19:28.907673 14950 leader_election.cc:288] T 00000000000000000000000000000000 P 23303da095fc456db7953ebcefd65d6f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:19:28.907696 14955 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23303da095fc456db7953ebcefd65d6f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:28.907810 14955 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23303da095fc456db7953ebcefd65d6f [term 1 LEADER]: Becoming Leader. State: Replica: 23303da095fc456db7953ebcefd65d6f, State: Running, Role: LEADER
I20260809 02:19:28.907943 14950 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23303da095fc456db7953ebcefd65d6f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:19:28.907959 14955 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23303da095fc456db7953ebcefd65d6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23303da095fc456db7953ebcefd65d6f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 43719 } }
I20260809 02:19:28.908524 14958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23303da095fc456db7953ebcefd65d6f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23303da095fc456db7953ebcefd65d6f. Latest consensus state: current_term: 1 leader_uuid: "23303da095fc456db7953ebcefd65d6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23303da095fc456db7953ebcefd65d6f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 43719 } } }
I20260809 02:19:28.908620 14958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23303da095fc456db7953ebcefd65d6f [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:28.908828 14956 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23303da095fc456db7953ebcefd65d6f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23303da095fc456db7953ebcefd65d6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23303da095fc456db7953ebcefd65d6f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 43719 } } }
I20260809 02:19:28.909106 14956 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23303da095fc456db7953ebcefd65d6f [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:28.909463 14966 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:19:28.910205 14966 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:19:28.911885 14966 catalog_manager.cc:1347] Generated new cluster ID: 8cacc83873b14e2b90428281699cf143
I20260809 02:19:28.911940 14966 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 02:19:28 dist-test-slave-w206 krb5kdc[14861](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241968, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:28.916020 14954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:28.905417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47076 (local address 127.11.93.190:43719)
0809 02:19:28.905617 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:28.905626 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:28.905659 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:19:28.905758 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:28.905764 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:28.905805 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:28.905935 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:28.906762 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:28.907873 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:28.908925 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:28.909679 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:28.909801 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:28.912590 (+ 2789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:28.912598 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:28.912599 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:28.912610 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:28.914285 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:28.914678 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:28.914681 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:28.914682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:28.914796 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:28.915049 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:28.915050 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:28.915050 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:28.915295 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:28.915479 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:28.915551 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 02:19:28.915690 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":108,"threads_started":1}
I20260809 02:19:28.920872 14966 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:19:28.921386 14966 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:19:28.926759 14966 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23303da095fc456db7953ebcefd65d6f: Generated new TSK 0
I20260809 02:19:28.926939 14966 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.93.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
I20260809 02:19:28.960292 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:43719
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:40349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:29.054801 14980 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:29.055043 14980 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:29.055115 14980 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:29.056259 14980 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:29.056299 14980 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:29.056334 14980 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:19:29.057767 14980 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:40349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:43719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14980
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:29.058018 14980 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:29.058254 14980 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:29.063237 14986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:29.063233 14988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:29.063266 14985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:29.063947 14980 server_base.cc:1034] running on GCE node
I20260809 02:19:29.064113 14980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:29.064313 14980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:29.065481 14980 hybrid_clock.cc:648] HybridClock initialized: now 1786241969065466 us; error 27 us; skew 500 ppm
Aug 09 02:19:29 dist-test-slave-w206 krb5kdc[14861](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241969, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:29.068431 14980 init.cc:377] Logged in from keytab as kudu/127.11.93.129@KRBTEST.COM (short username kudu)
I20260809 02:19:29.068903 14980 webserver.cc:460] Webserver started at http://127.11.93.129:41483/ using document root <none> and password file <none>
I20260809 02:19:29.069167 14980 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:29.069243 14980 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:29.069399 14980 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:29.070495 14980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "78a1f550860c4be685fffb9fc1421a64"
format_stamp: "Formatted at 2026-08-09 02:19:29 on dist-test-slave-w206"
server_key: "0bfcd0b606141f14b5b7afca1b1223d8"
server_key_iv: "5012eb6d6c0d9e5b8a4100d7deaf9f2d"
server_key_version: "encryptionkey@0"
I20260809 02:19:29.070914 14980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "78a1f550860c4be685fffb9fc1421a64"
format_stamp: "Formatted at 2026-08-09 02:19:29 on dist-test-slave-w206"
server_key: "0bfcd0b606141f14b5b7afca1b1223d8"
server_key_iv: "5012eb6d6c0d9e5b8a4100d7deaf9f2d"
server_key_version: "encryptionkey@0"
I20260809 02:19:29.072337 14980 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:19:29.073060 14995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:29.073242 14980 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:29.073347 14980 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "78a1f550860c4be685fffb9fc1421a64"
format_stamp: "Formatted at 2026-08-09 02:19:29 on dist-test-slave-w206"
server_key: "0bfcd0b606141f14b5b7afca1b1223d8"
server_key_iv: "5012eb6d6c0d9e5b8a4100d7deaf9f2d"
server_key_version: "encryptionkey@0"
I20260809 02:19:29.073444 14980 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:29.081215 14980 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:29.083302 14980 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:29.083494 14980 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:29.083741 14980 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:29.084061 14980 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:29.084118 14980 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:29.084162 14980 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:29.084195 14980 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:29.090644 14980 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:35645
I20260809 02:19:29.090678 15116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:35645 every 8 connection(s)
I20260809 02:19:29.091065 14980 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:19:29.096423 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 14980
I20260809 02:19:29.096510 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:19:29.096720 11638 external_mini_cluster.cc:1428] Setting key 21d6fa9c2c3e353e9f9d85e0313809f2
Aug 09 02:19:29 dist-test-slave-w206 krb5kdc[14861](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241969, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:29.101099 14954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:29.091790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:49765 (local address 127.11.93.190:43719)
0809 02:19:29.091856 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:29.091858 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:29.092082 (+ 224us) server_negotiation.cc:407] Connection header received
0809 02:19:29.092563 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:29.092565 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:29.092582 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:29.092644 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:29.093560 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:29.094147 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:29.095235 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:29.095445 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:29.095511 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:29.097818 (+ 2307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:29.097819 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:29.097820 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:29.097828 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:29.099516 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:29.100013 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:29.100014 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:29.100014 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:29.100066 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:29.100369 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:29.100370 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:29.100370 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:29.100485 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:29.100535 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:29.100900 (+ 365us) server_negotiation.cc:299] Negotiation successful
0809 02:19:29.101017 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 02:19:29.101286 15119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:29.091788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:43719 (local address 127.11.93.129:49765)
0809 02:19:29.091982 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:29.092015 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:29.092471 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:29.092713 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:29.092717 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:29.093276 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:29.093453 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:29.093457 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:29.094278 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:29.094279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:29.095158 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:29.095160 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:29.095525 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:29.095526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:29.095626 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:29.096136 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:29.096143 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:29.097723 (+ 1580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:29.099605 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:29.099612 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:29.099614 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:29.099934 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:29.100130 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:29.100131 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:29.100131 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:29.100272 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:29.100550 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:29.100556 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:29.100718 (+ 162us) client_negotiation.cc:769] Sending connection context
0809 02:19:29.100834 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 02:19:29.101012 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":106,"threads_started":1}
I20260809 02:19:29.101850 15117 heartbeater.cc:347] Connected to a master server at 127.11.93.190:43719
I20260809 02:19:29.101975 15117 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:29.102169 15117 heartbeater.cc:511] Master 127.11.93.190:43719 requested a full tablet report, sending...
I20260809 02:19:29.102816 14908 ts_manager.cc:194] Registered new tserver with Master: 78a1f550860c4be685fffb9fc1421a64 (127.11.93.129:35645)
I20260809 02:19:29.103847 14908 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:49765
WARNING: no policy specified for kudu/127.11.93.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
I20260809 02:19:29.125959 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:43719
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:40349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:29.210157 15123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:29.210378 15123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:29.210403 15123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:29.211625 15123 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:29.211669 15123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:29.211696 15123 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:19:29.213124 15123 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:40349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:43719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15123
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:29.213327 15123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:29.213519 15123 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:29.218617 15128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:29.218644 15123 server_base.cc:1034] running on GCE node
W20260809 02:19:29.218629 15129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:29.218623 15131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:29.219165 15123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:29.219455 15123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:29.220633 15123 hybrid_clock.cc:648] HybridClock initialized: now 1786241969220625 us; error 36 us; skew 500 ppm
Aug 09 02:19:29 dist-test-slave-w206 krb5kdc[14861](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241969, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:29.223204 15123 init.cc:377] Logged in from keytab as kudu/127.11.93.130@KRBTEST.COM (short username kudu)
I20260809 02:19:29.223649 15123 webserver.cc:460] Webserver started at http://127.11.93.130:42689/ using document root <none> and password file <none>
I20260809 02:19:29.223891 15123 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:29.223973 15123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:29.224109 15123 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:29.225189 15123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "56e02124123645b1bcda8ec1a63204b4"
format_stamp: "Formatted at 2026-08-09 02:19:29 on dist-test-slave-w206"
server_key: "94e19e486597c331f1b45f5f3a41adb2"
server_key_iv: "28100dc2672ad4ea07d7d469d46a5787"
server_key_version: "encryptionkey@0"
I20260809 02:19:29.225566 15123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "56e02124123645b1bcda8ec1a63204b4"
format_stamp: "Formatted at 2026-08-09 02:19:29 on dist-test-slave-w206"
server_key: "94e19e486597c331f1b45f5f3a41adb2"
server_key_iv: "28100dc2672ad4ea07d7d469d46a5787"
server_key_version: "encryptionkey@0"
I20260809 02:19:29.226914 15123 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:19:29.227679 15138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:29.227856 15123 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:19:29.227967 15123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "56e02124123645b1bcda8ec1a63204b4"
format_stamp: "Formatted at 2026-08-09 02:19:29 on dist-test-slave-w206"
server_key: "94e19e486597c331f1b45f5f3a41adb2"
server_key_iv: "28100dc2672ad4ea07d7d469d46a5787"
server_key_version: "encryptionkey@0"
I20260809 02:19:29.228040 15123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:29.236440 15123 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:29.238238 15123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:29.238404 15123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:29.238633 15123 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:29.238947 15123 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:29.239027 15123 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:29.239071 15123 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:29.239091 15123 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:29.245110 15123 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:34873
I20260809 02:19:29.245158 15254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:34873 every 8 connection(s)
I20260809 02:19:29.245468 15123 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
Aug 09 02:19:29 dist-test-slave-w206 krb5kdc[14861](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241969, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:29.251447 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 15123
I20260809 02:19:29.251571 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:19:29.251777 11638 external_mini_cluster.cc:1428] Setting key becbb4624fbde91bdb9e7575106b8798
I20260809 02:19:29.255059 14954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:29.246097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:37957 (local address 127.11.93.190:43719)
0809 02:19:29.246143 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:29.246145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:29.246324 (+ 179us) server_negotiation.cc:407] Connection header received
0809 02:19:29.246852 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:29.246853 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:29.246867 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:29.246932 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:29.247891 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:29.248441 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:29.249431 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:29.249635 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:29.249722 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:29.251985 (+ 2263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:29.251986 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:29.251987 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:29.251994 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:29.253502 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:29.254001 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:29.254002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:29.254002 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:29.254051 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:29.254355 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:29.254356 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:29.254356 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:29.254506 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:29.254582 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:29.254817 (+ 235us) server_negotiation.cc:299] Negotiation successful
0809 02:19:29.254919 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 02:19:29.255170 15257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:29.246052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:43719 (local address 127.11.93.130:37957)
0809 02:19:29.246198 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:29.246243 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:29.246744 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:29.247029 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:29.247033 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:29.247602 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:29.247787 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:29.247791 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:29.248541 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:29.248542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:29.249330 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:29.249333 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:29.249732 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:29.249734 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:29.249863 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:29.250333 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:29.250341 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:29.251897 (+ 1556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:29.253588 (+ 1691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:29.253595 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:29.253597 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:29.253927 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:29.254117 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:29.254119 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:29.254119 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:29.254271 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:29.254576 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:29.254581 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:29.254690 (+ 109us) client_negotiation.cc:769] Sending connection context
0809 02:19:29.254773 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 02:19:29.254911 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":67,"threads_started":1}
I20260809 02:19:29.255653 15255 heartbeater.cc:347] Connected to a master server at 127.11.93.190:43719
I20260809 02:19:29.255752 15255 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:29.255941 15255 heartbeater.cc:511] Master 127.11.93.190:43719 requested a full tablet report, sending...
I20260809 02:19:29.256313 14908 ts_manager.cc:194] Registered new tserver with Master: 56e02124123645b1bcda8ec1a63204b4 (127.11.93.130:34873)
I20260809 02:19:29.256863 14908 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:37957
WARNING: no policy specified for kudu/127.11.93.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
I20260809 02:19:29.279862 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:43719
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:40349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:29.362069 15260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:29.362278 15260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:29.362303 15260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:29.363513 15260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:29.363559 15260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:29.363587 15260 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:19:29.365061 15260 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:40349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:43719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15260
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:29.365303 15260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:29.365592 15260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:19:29.371001 15260 server_base.cc:1034] running on GCE node
W20260809 02:19:29.370796 15269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:29.370791 15266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:29.370901 15267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:29.371354 15260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:29.371613 15260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:29.372784 15260 hybrid_clock.cc:648] HybridClock initialized: now 1786241969372694 us; error 122 us; skew 500 ppm
Aug 09 02:19:29 dist-test-slave-w206 krb5kdc[14861](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241969, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:29.375665 15260 init.cc:377] Logged in from keytab as kudu/127.11.93.131@KRBTEST.COM (short username kudu)
I20260809 02:19:29.376106 15260 webserver.cc:460] Webserver started at http://127.11.93.131:43697/ using document root <none> and password file <none>
I20260809 02:19:29.376362 15260 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:29.376434 15260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:29.376616 15260 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:29.377668 15260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "66c74731c66847c68c4c8e52dbef5e1f"
format_stamp: "Formatted at 2026-08-09 02:19:29 on dist-test-slave-w206"
server_key: "d5400367fce9084b5c6ad05ca4b023e4"
server_key_iv: "05e753e378043395a7b5c944438f8402"
server_key_version: "encryptionkey@0"
I20260809 02:19:29.378031 15260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "66c74731c66847c68c4c8e52dbef5e1f"
format_stamp: "Formatted at 2026-08-09 02:19:29 on dist-test-slave-w206"
server_key: "d5400367fce9084b5c6ad05ca4b023e4"
server_key_iv: "05e753e378043395a7b5c944438f8402"
server_key_version: "encryptionkey@0"
I20260809 02:19:29.379458 15260 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:19:29.380282 15277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:29.380491 15260 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 02:19:29.380587 15260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "66c74731c66847c68c4c8e52dbef5e1f"
format_stamp: "Formatted at 2026-08-09 02:19:29 on dist-test-slave-w206"
server_key: "d5400367fce9084b5c6ad05ca4b023e4"
server_key_iv: "05e753e378043395a7b5c944438f8402"
server_key_version: "encryptionkey@0"
I20260809 02:19:29.380662 15260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:29.394549 15260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:29.396819 15260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:29.396960 15260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:29.397137 15260 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:29.397395 15260 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:29.397428 15260 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:29.397450 15260 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:29.397462 15260 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:29.403188 15260 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:38867
I20260809 02:19:29.403272 15404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:38867 every 8 connection(s)
I20260809 02:19:29.403612 15260 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:19:29.405452 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 15260
I20260809 02:19:29.405537 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:19:29.405755 11638 external_mini_cluster.cc:1428] Setting key ff6a294dd6c322617640fa768e9a09ce
Aug 09 02:19:29 dist-test-slave-w206 krb5kdc[14861](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241969, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:29.413636 14954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:29.404397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:48003 (local address 127.11.93.190:43719)
0809 02:19:29.404462 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:29.404464 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:29.404670 (+ 206us) server_negotiation.cc:407] Connection header received
0809 02:19:29.405246 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:29.405248 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:29.405279 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:29.405337 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:29.406573 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:29.407287 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:29.408323 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:29.408558 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:29.408668 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:29.411019 (+ 2351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:29.411021 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:29.411021 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:29.411029 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:29.412202 (+ 1173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:29.412640 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:29.412641 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:29.412642 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:29.412706 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:29.412953 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:29.412954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:29.412954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:29.413080 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:29.413153 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:29.413456 (+ 303us) server_negotiation.cc:299] Negotiation successful
0809 02:19:29.413540 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 02:19:29.413836 15407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:29.404395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:43719 (local address 127.11.93.131:48003)
0809 02:19:29.404550 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:29.404586 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:29.405112 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:29.405422 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:29.405426 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:29.406202 (+ 776us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:29.406492 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:29.406498 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:29.407368 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:29.407369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:29.408250 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:29.408252 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:29.408665 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:29.408667 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:29.408826 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:29.409359 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:29.409367 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:29.410886 (+ 1519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:29.412325 (+ 1439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:29.412333 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:29.412335 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:29.412559 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:29.412776 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:29.412777 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:29.412778 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:29.412884 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:29.413155 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:29.413162 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:29.413319 (+ 157us) client_negotiation.cc:769] Sending connection context
0809 02:19:29.413433 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 02:19:29.413590 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":67,"threads_started":1}
I20260809 02:19:29.414324 15405 heartbeater.cc:347] Connected to a master server at 127.11.93.190:43719
I20260809 02:19:29.414407 15405 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:29.414603 15405 heartbeater.cc:511] Master 127.11.93.190:43719 requested a full tablet report, sending...
I20260809 02:19:29.415059 14908 ts_manager.cc:194] Registered new tserver with Master: 66c74731c66847c68c4c8e52dbef5e1f (127.11.93.131:38867)
I20260809 02:19:29.415443 14908 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:48003
I20260809 02:19:29.417735 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 02:19:29 dist-test-slave-w206 krb5kdc[14861](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241969, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 09 02:19:29 dist-test-slave-w206 krb5kdc[14861](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241969, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:29.443574 14954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:29.435931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47078 (local address 127.11.93.190:43719)
0809 02:19:29.436083 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:29.436085 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:29.436153 (+ 68us) server_negotiation.cc:407] Connection header received
0809 02:19:29.436315 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:29.436317 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:29.436332 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:29.436367 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:29.437022 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:29.437545 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:29.438292 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:29.438492 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:29.438551 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:29.440992 (+ 2441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:29.440994 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:29.440994 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:29.441001 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:29.442422 (+ 1421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:29.442760 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:29.442761 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:29.442761 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:29.442816 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:29.443070 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:29.443071 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:29.443071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:29.443221 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:29.443329 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:29.443445 (+ 116us) server_negotiation.cc:299] Negotiation successful
0809 02:19:29.443506 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
W20260809 02:19:29.443887 14908 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:47078
I20260809 02:19:29.444339 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 14980
I20260809 02:19:29.451406 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 15123
I20260809 02:19:29.458391 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 15260
I20260809 02:19:29.463591 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 14874
2026-08-09T02:19:29Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1890 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:19:29 dist-test-slave-w206 krb5kdc[15418](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:19:29 dist-test-slave-w206 krb5kdc[15418](info): set up 2 sockets
Aug 09 02:19:29 dist-test-slave-w206 krb5kdc[15418](info): commencing operation
krb5kdc: starting...
W20260809 02:19:30.546474 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.062s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:19:30 dist-test-slave-w206 krb5kdc[15418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241970, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:19:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:19:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:19:30.677762 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:32897
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:32897
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:30.760979 15432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:30.761214 15432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:30.761251 15432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:30.762394 15432 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:19:30.762461 15432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:30.762485 15432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:30.762503 15432 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:19:30.762535 15432 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:19:30.764115 15432 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:32897
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:32897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15432
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:30.764398 15432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:30.764621 15432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:30.769390 15438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:30.769337 15441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:30.769419 15439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:30.769701 15432 server_base.cc:1034] running on GCE node
I20260809 02:19:30.769925 15432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:30.770231 15432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:30.771384 15432 hybrid_clock.cc:648] HybridClock initialized: now 1786241970771371 us; error 30 us; skew 500 ppm
Aug 09 02:19:30 dist-test-slave-w206 krb5kdc[15418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241970, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:30.773769 15432 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:19:30.774233 15432 webserver.cc:460] Webserver started at http://127.11.93.190:36827/ using document root <none> and password file <none>
I20260809 02:19:30.774466 15432 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:30.774513 15432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:30.774652 15432 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:30.775759 15432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "4687ec9218184a03bdbfab5781b6c3d0"
format_stamp: "Formatted at 2026-08-09 02:19:30 on dist-test-slave-w206"
server_key: "db431e3bd1e69cce4e41600318bed07d"
server_key_iv: "ea750759795503a47ada18793fd7c06d"
server_key_version: "encryptionkey@0"
I20260809 02:19:30.776111 15432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "4687ec9218184a03bdbfab5781b6c3d0"
format_stamp: "Formatted at 2026-08-09 02:19:30 on dist-test-slave-w206"
server_key: "db431e3bd1e69cce4e41600318bed07d"
server_key_iv: "ea750759795503a47ada18793fd7c06d"
server_key_version: "encryptionkey@0"
I20260809 02:19:30.777448 15432 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 02:19:30.778157 15449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:30.778342 15432 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:30.778479 15432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "4687ec9218184a03bdbfab5781b6c3d0"
format_stamp: "Formatted at 2026-08-09 02:19:30 on dist-test-slave-w206"
server_key: "db431e3bd1e69cce4e41600318bed07d"
server_key_iv: "ea750759795503a47ada18793fd7c06d"
server_key_version: "encryptionkey@0"
I20260809 02:19:30.778568 15432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:30.793922 15432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:30.795855 15432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:30.796028 15432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:30.800261 15432 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:32897
I20260809 02:19:30.800303 15508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:32897 every 8 connection(s)
I20260809 02:19:30.800844 15432 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:19:30.801533 15509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:30.803520 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 15432
I20260809 02:19:30.803623 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:19:30.803890 11638 external_mini_cluster.cc:1428] Setting key f1693411fbccb6e4646b4a293294fa57
I20260809 02:19:30.804029 15509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4687ec9218184a03bdbfab5781b6c3d0: Bootstrap starting.
I20260809 02:19:30.804773 15509 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4687ec9218184a03bdbfab5781b6c3d0: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:30.805088 15509 log.cc:824] T 00000000000000000000000000000000 P 4687ec9218184a03bdbfab5781b6c3d0: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:30.805907 15509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4687ec9218184a03bdbfab5781b6c3d0: No bootstrap required, opened a new log
I20260809 02:19:30.808359 15509 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4687ec9218184a03bdbfab5781b6c3d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4687ec9218184a03bdbfab5781b6c3d0" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 32897 } }
I20260809 02:19:30.808501 15509 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4687ec9218184a03bdbfab5781b6c3d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:30.808523 15509 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4687ec9218184a03bdbfab5781b6c3d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4687ec9218184a03bdbfab5781b6c3d0, State: Initialized, Role: FOLLOWER
I20260809 02:19:30.808657 15509 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4687ec9218184a03bdbfab5781b6c3d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4687ec9218184a03bdbfab5781b6c3d0" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 32897 } }
I20260809 02:19:30.808733 15509 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4687ec9218184a03bdbfab5781b6c3d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:19:30.808784 15509 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4687ec9218184a03bdbfab5781b6c3d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:19:30.808833 15509 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4687ec9218184a03bdbfab5781b6c3d0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:30.809479 15509 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4687ec9218184a03bdbfab5781b6c3d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4687ec9218184a03bdbfab5781b6c3d0" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 32897 } }
I20260809 02:19:30.809590 15509 leader_election.cc:302] T 00000000000000000000000000000000 P 4687ec9218184a03bdbfab5781b6c3d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4687ec9218184a03bdbfab5781b6c3d0; no voters:
I20260809 02:19:30.809765 15509 leader_election.cc:288] T 00000000000000000000000000000000 P 4687ec9218184a03bdbfab5781b6c3d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:19:30.809792 15514 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4687ec9218184a03bdbfab5781b6c3d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:30.809908 15514 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4687ec9218184a03bdbfab5781b6c3d0 [term 1 LEADER]: Becoming Leader. State: Replica: 4687ec9218184a03bdbfab5781b6c3d0, State: Running, Role: LEADER
I20260809 02:19:30.810047 15509 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4687ec9218184a03bdbfab5781b6c3d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:19:30.810070 15514 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4687ec9218184a03bdbfab5781b6c3d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4687ec9218184a03bdbfab5781b6c3d0" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 32897 } }
I20260809 02:19:30.810432 15516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4687ec9218184a03bdbfab5781b6c3d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4687ec9218184a03bdbfab5781b6c3d0. Latest consensus state: current_term: 1 leader_uuid: "4687ec9218184a03bdbfab5781b6c3d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4687ec9218184a03bdbfab5781b6c3d0" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 32897 } } }
I20260809 02:19:30.810601 15516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4687ec9218184a03bdbfab5781b6c3d0 [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:30.810431 15515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4687ec9218184a03bdbfab5781b6c3d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4687ec9218184a03bdbfab5781b6c3d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4687ec9218184a03bdbfab5781b6c3d0" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 32897 } } }
I20260809 02:19:30.810884 15521 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:19:30.811479 15521 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 02:19:30 dist-test-slave-w206 krb5kdc[15418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241970, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:30.810905 15515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4687ec9218184a03bdbfab5781b6c3d0 [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:30.813165 15521 catalog_manager.cc:1347] Generated new cluster ID: 5346b7cbe429461c9aa7299f683ff0ce
I20260809 02:19:30.813220 15521 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:19:30.816408 15512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:30.804471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36698 (local address 127.11.93.190:32897)
0809 02:19:30.804643 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:30.804656 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:30.804681 (+ 25us) server_negotiation.cc:407] Connection header received
0809 02:19:30.805158 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:30.805165 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:30.805251 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:30.805415 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:30.806172 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:30.807120 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:30.808240 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:30.808746 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:30.808867 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:30.812496 (+ 3629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:30.812501 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:30.812502 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:30.812514 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:30.814669 (+ 2155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:30.815128 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:30.815131 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:30.815131 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:30.815230 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:30.815477 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:30.815478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:30.815478 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:30.815763 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:30.815908 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:30.816075 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 02:19:30.816203 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":91,"threads_started":1}
I20260809 02:19:30.818704 15521 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:19:30.819514 15521 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:19:30.828760 15521 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4687ec9218184a03bdbfab5781b6c3d0: Generated new TSK 0
I20260809 02:19:30.828963 15521 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.93.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
I20260809 02:19:30.857635 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:32897
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:30.945206 15535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:30.945509 15535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:30.945609 15535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:30.947737 15535 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:30.947803 15535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:30.947852 15535 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:19:30.949993 15535 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:32897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15535
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:30.950271 15535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:30.950522 15535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:30.956570 15540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:30.956602 15541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:30.956753 15543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:30.958832 15535 server_base.cc:1034] running on GCE node
I20260809 02:19:30.959110 15535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:30.959435 15535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:30.960609 15535 hybrid_clock.cc:648] HybridClock initialized: now 1786241970960591 us; error 32 us; skew 500 ppm
Aug 09 02:19:30 dist-test-slave-w206 krb5kdc[15418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241970, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:30.968598 15535 init.cc:377] Logged in from keytab as kudu/127.11.93.129@KRBTEST.COM (short username kudu)
I20260809 02:19:30.969401 15535 webserver.cc:460] Webserver started at http://127.11.93.129:35609/ using document root <none> and password file <none>
I20260809 02:19:30.969749 15535 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:30.969863 15535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:30.970022 15535 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:30.971689 15535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "6f5b86df28a34f5e935fd84a28a25bb4"
format_stamp: "Formatted at 2026-08-09 02:19:30 on dist-test-slave-w206"
server_key: "237e7b656bf8c5feb43fb5fa35d25fb1"
server_key_iv: "b6ff86d38ab4fb1bd843b31f0e0823f1"
server_key_version: "encryptionkey@0"
I20260809 02:19:30.972178 15535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "6f5b86df28a34f5e935fd84a28a25bb4"
format_stamp: "Formatted at 2026-08-09 02:19:30 on dist-test-slave-w206"
server_key: "237e7b656bf8c5feb43fb5fa35d25fb1"
server_key_iv: "b6ff86d38ab4fb1bd843b31f0e0823f1"
server_key_version: "encryptionkey@0"
I20260809 02:19:30.974243 15535 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:19:30.975250 15550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:30.975466 15535 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:30.975570 15535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "6f5b86df28a34f5e935fd84a28a25bb4"
format_stamp: "Formatted at 2026-08-09 02:19:30 on dist-test-slave-w206"
server_key: "237e7b656bf8c5feb43fb5fa35d25fb1"
server_key_iv: "b6ff86d38ab4fb1bd843b31f0e0823f1"
server_key_version: "encryptionkey@0"
I20260809 02:19:30.975646 15535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:31.006932 15535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:31.009126 15535 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:31.009276 15535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:31.009553 15535 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:31.009892 15535 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:31.009940 15535 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:31.009999 15535 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:31.010030 15535 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:31.015869 15535 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:43487
I20260809 02:19:31.015914 15677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:43487 every 8 connection(s)
I20260809 02:19:31.016227 15535 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
Aug 09 02:19:31 dist-test-slave-w206 krb5kdc[15418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241970, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:31.023613 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 15535
I20260809 02:19:31.023711 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:19:31.023906 11638 external_mini_cluster.cc:1428] Setting key 0954514f41d2efd49e159fd01ff8759b
I20260809 02:19:31.025887 15512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:31.016977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:37085 (local address 127.11.93.190:32897)
0809 02:19:31.017020 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:31.017022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:31.017208 (+ 186us) server_negotiation.cc:407] Connection header received
0809 02:19:31.018107 (+ 899us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:31.018108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:31.018118 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:31.018176 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:31.018756 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:31.019277 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:31.020305 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:31.020499 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:31.020549 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:31.022584 (+ 2035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:31.022585 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:31.022586 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:31.022592 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:31.024217 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:31.024924 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:31.024925 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:31.024925 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:31.024979 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:31.025268 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:31.025269 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:31.025269 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:31.025370 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:31.025429 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:31.025742 (+ 313us) server_negotiation.cc:299] Negotiation successful
0809 02:19:31.025817 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 02:19:31.026188 15680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:31.016902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:32897 (local address 127.11.93.129:37085)
0809 02:19:31.017077 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:31.017117 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:31.018004 (+ 887us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:31.018230 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:31.018233 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:31.018482 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:31.018668 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:31.018688 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:31.019382 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:31.019384 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:31.020217 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:31.020221 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:31.020574 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:31.020575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:31.020680 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:31.021119 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:31.021127 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:31.022496 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:31.024497 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:31.024504 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:31.024507 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:31.024847 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:31.025047 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:31.025048 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:31.025048 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:31.025202 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:31.025444 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:31.025449 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:31.025613 (+ 164us) client_negotiation.cc:769] Sending connection context
0809 02:19:31.025725 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 02:19:31.025900 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":105,"threads_started":1}
I20260809 02:19:31.026768 15678 heartbeater.cc:347] Connected to a master server at 127.11.93.190:32897
I20260809 02:19:31.026873 15678 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:31.027136 15678 heartbeater.cc:511] Master 127.11.93.190:32897 requested a full tablet report, sending...
I20260809 02:19:31.027818 15468 ts_manager.cc:194] Registered new tserver with Master: 6f5b86df28a34f5e935fd84a28a25bb4 (127.11.93.129:43487)
I20260809 02:19:31.028424 15468 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:37085
WARNING: no policy specified for kudu/127.11.93.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
I20260809 02:19:31.050086 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:32897
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:31.131898 15683 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:31.132103 15683 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:31.132126 15683 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:31.133239 15683 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:31.133273 15683 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:31.133298 15683 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:19:31.134852 15683 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:32897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15683
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:31.135100 15683 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:31.135288 15683 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:31.140198 15688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:31.140331 15689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:31.140434 15691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:31.140789 15683 server_base.cc:1034] running on GCE node
I20260809 02:19:31.141011 15683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:31.141249 15683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:31.142400 15683 hybrid_clock.cc:648] HybridClock initialized: now 1786241971142369 us; error 43 us; skew 500 ppm
Aug 09 02:19:31 dist-test-slave-w206 krb5kdc[15418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241971, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:31.145162 15683 init.cc:377] Logged in from keytab as kudu/127.11.93.130@KRBTEST.COM (short username kudu)
I20260809 02:19:31.145639 15683 webserver.cc:460] Webserver started at http://127.11.93.130:36863/ using document root <none> and password file <none>
I20260809 02:19:31.145869 15683 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:31.145941 15683 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:31.146096 15683 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:31.147225 15683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "ed634a61f6dd43b2b02b3c2f537b16f1"
format_stamp: "Formatted at 2026-08-09 02:19:31 on dist-test-slave-w206"
server_key: "ccbd79918ea99ff0d9fd75157faae343"
server_key_iv: "0870d8b8ffa89cfd4139c7bfb1ef42d5"
server_key_version: "encryptionkey@0"
I20260809 02:19:31.147598 15683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "ed634a61f6dd43b2b02b3c2f537b16f1"
format_stamp: "Formatted at 2026-08-09 02:19:31 on dist-test-slave-w206"
server_key: "ccbd79918ea99ff0d9fd75157faae343"
server_key_iv: "0870d8b8ffa89cfd4139c7bfb1ef42d5"
server_key_version: "encryptionkey@0"
I20260809 02:19:31.148943 15683 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:19:31.149673 15699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:31.149843 15683 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:19:31.149943 15683 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "ed634a61f6dd43b2b02b3c2f537b16f1"
format_stamp: "Formatted at 2026-08-09 02:19:31 on dist-test-slave-w206"
server_key: "ccbd79918ea99ff0d9fd75157faae343"
server_key_iv: "0870d8b8ffa89cfd4139c7bfb1ef42d5"
server_key_version: "encryptionkey@0"
I20260809 02:19:31.150024 15683 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:31.165313 15683 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:31.167631 15683 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:31.167795 15683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:31.168041 15683 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:31.168358 15683 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:31.168424 15683 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:31.168470 15683 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:31.168494 15683 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:31.174422 15683 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:45777
I20260809 02:19:31.174467 15819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:45777 every 8 connection(s)
I20260809 02:19:31.174852 15683 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:19:31.175417 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 15683
I20260809 02:19:31.175550 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:19:31.175820 11638 external_mini_cluster.cc:1428] Setting key e69753bba483b5daf3d75f3f5580c969
Aug 09 02:19:31 dist-test-slave-w206 krb5kdc[15418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241971, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.93.131@KRBTEST.COM; defaulting to no policy
I20260809 02:19:31.185580 15512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:31.175691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:33263 (local address 127.11.93.190:32897)
0809 02:19:31.175771 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:31.175773 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:31.176041 (+ 268us) server_negotiation.cc:407] Connection header received
0809 02:19:31.177424 (+ 1383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:31.177425 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:31.177434 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:31.177470 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:31.178356 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:31.178876 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:31.179926 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:31.180128 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:31.180232 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:31.182657 (+ 2425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:31.182658 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:31.182658 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:31.182666 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:31.184147 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:31.184551 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:31.184552 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:31.184552 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:31.184613 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:31.184941 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:31.184942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:31.184943 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:31.185058 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:31.185138 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:31.185402 (+ 264us) server_negotiation.cc:299] Negotiation successful
0809 02:19:31.185486 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:19:31.185777 15824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:31.175653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:32897 (local address 127.11.93.130:33263)
0809 02:19:31.175879 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:31.175933 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:31.177310 (+ 1377us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:31.177555 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:31.177558 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:31.177988 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:31.178269 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:31.178274 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:31.179000 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:31.179001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:31.179799 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:31.179801 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:31.180325 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:31.180326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:31.180442 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:31.181059 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:31.181067 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:31.182560 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:31.184230 (+ 1670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:31.184237 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:31.184240 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:31.184471 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:31.184682 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:31.184683 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:31.184684 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:31.184853 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:31.185127 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:31.185133 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:31.185271 (+ 138us) client_negotiation.cc:769] Sending connection context
0809 02:19:31.185388 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 02:19:31.185546 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":114,"threads_started":1}
I20260809 02:19:31.186349 15821 heartbeater.cc:347] Connected to a master server at 127.11.93.190:32897
I20260809 02:19:31.186466 15821 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:31.186635 15821 heartbeater.cc:511] Master 127.11.93.190:32897 requested a full tablet report, sending...
I20260809 02:19:31.187100 15468 ts_manager.cc:194] Registered new tserver with Master: ed634a61f6dd43b2b02b3c2f537b16f1 (127.11.93.130:45777)
I20260809 02:19:31.187489 15468 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:33263
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
I20260809 02:19:31.202054 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:32897
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:31.285749 15827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:31.285952 15827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:31.285974 15827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:31.287140 15827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:31.287182 15827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:31.287209 15827 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:19:31.288640 15827 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:32897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15827
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:31.288822 15827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:31.289007 15827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:31.293931 15832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:31.293990 15827 server_base.cc:1034] running on GCE node
W20260809 02:19:31.293982 15833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:31.293931 15835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:31.294375 15827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:31.294574 15827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:31.295711 15827 hybrid_clock.cc:648] HybridClock initialized: now 1786241971295703 us; error 29 us; skew 500 ppm
Aug 09 02:19:31 dist-test-slave-w206 krb5kdc[15418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241971, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:31.298448 15827 init.cc:377] Logged in from keytab as kudu/127.11.93.131@KRBTEST.COM (short username kudu)
I20260809 02:19:31.298931 15827 webserver.cc:460] Webserver started at http://127.11.93.131:45909/ using document root <none> and password file <none>
I20260809 02:19:31.299196 15827 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:31.299268 15827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:31.299427 15827 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:31.300473 15827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "d0a0baefd13f427b8cc82519c9c5ef06"
format_stamp: "Formatted at 2026-08-09 02:19:31 on dist-test-slave-w206"
server_key: "2d4ea37bac66814b8306aff22b24dca0"
server_key_iv: "3abce9d83ef17dbaafa32f43aef3ad2d"
server_key_version: "encryptionkey@0"
I20260809 02:19:31.300843 15827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "d0a0baefd13f427b8cc82519c9c5ef06"
format_stamp: "Formatted at 2026-08-09 02:19:31 on dist-test-slave-w206"
server_key: "2d4ea37bac66814b8306aff22b24dca0"
server_key_iv: "3abce9d83ef17dbaafa32f43aef3ad2d"
server_key_version: "encryptionkey@0"
I20260809 02:19:31.302228 15827 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:19:31.302937 15844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:31.303360 15827 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:19:31.303462 15827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "d0a0baefd13f427b8cc82519c9c5ef06"
format_stamp: "Formatted at 2026-08-09 02:19:31 on dist-test-slave-w206"
server_key: "2d4ea37bac66814b8306aff22b24dca0"
server_key_iv: "3abce9d83ef17dbaafa32f43aef3ad2d"
server_key_version: "encryptionkey@0"
I20260809 02:19:31.303543 15827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:31.322886 15827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:31.325368 15827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:31.325541 15827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:31.325801 15827 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:31.326118 15827 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:31.326182 15827 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:31.326247 15827 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:31.326278 15827 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:31.332543 15827 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:37125
I20260809 02:19:31.332589 15962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:37125 every 8 connection(s)
I20260809 02:19:31.332907 15827 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:19:31.337566 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 15827
I20260809 02:19:31.337688 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:19:31.337898 11638 external_mini_cluster.cc:1428] Setting key 07648951864cab61a92c85d8010ef68a
Aug 09 02:19:31 dist-test-slave-w206 krb5kdc[15418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241971, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:31.343045 15512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:31.333610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:55597 (local address 127.11.93.190:32897)
0809 02:19:31.333655 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:31.333657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:31.333894 (+ 237us) server_negotiation.cc:407] Connection header received
0809 02:19:31.334850 (+ 956us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:31.334851 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:31.334864 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:31.334941 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:31.335624 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:31.336125 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:31.337156 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:31.337366 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:31.337457 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:31.339967 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:31.339968 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:31.339969 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:31.339976 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:31.341438 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:31.341919 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:31.341921 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:31.341921 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:31.341991 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:31.342282 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:31.342283 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:31.342283 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:31.342430 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:31.342520 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:31.342817 (+ 297us) server_negotiation.cc:299] Negotiation successful
0809 02:19:31.342907 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 02:19:31.343286 15967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:31.333585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:32897 (local address 127.11.93.131:55597)
0809 02:19:31.333766 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:31.333802 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:31.334736 (+ 934us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:31.335053 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:31.335058 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:31.335312 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:31.335516 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:31.335520 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:31.336222 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:31.336223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:31.337033 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:31.337035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:31.337468 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:31.337470 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:31.337593 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:31.338201 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:31.338212 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:31.339844 (+ 1632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:31.341551 (+ 1707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:31.341559 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:31.341561 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:31.341816 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:31.342067 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:31.342069 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:31.342069 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:31.342204 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:31.342509 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:31.342516 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:31.342672 (+ 156us) client_negotiation.cc:769] Sending connection context
0809 02:19:31.342794 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 02:19:31.342963 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":90,"threads_started":1}
I20260809 02:19:31.343791 15964 heartbeater.cc:347] Connected to a master server at 127.11.93.190:32897
I20260809 02:19:31.343889 15964 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:31.344063 15964 heartbeater.cc:511] Master 127.11.93.190:32897 requested a full tablet report, sending...
I20260809 02:19:31.344431 15468 ts_manager.cc:194] Registered new tserver with Master: d0a0baefd13f427b8cc82519c9c5ef06 (127.11.93.131:37125)
I20260809 02:19:31.344789 15468 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:55597
I20260809 02:19:31.349843 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 02:19:31 dist-test-slave-w206 krb5kdc[15418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241971, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 02:19:31 dist-test-slave-w206 krb5kdc[15418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241971, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.129@KRBTEST.COM
I20260809 02:19:31.373605 15972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:31.365964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44672 (local address 127.11.93.129:43487)
0809 02:19:31.366228 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:31.366235 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:31.366249 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:19:31.366283 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:31.366285 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:31.366308 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:31.366378 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:31.366915 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:31.367684 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:31.368403 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:31.368702 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:31.368755 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:31.370921 (+ 2166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:31.370929 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:31.370930 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:31.370936 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:31.372419 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:31.372731 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:31.372733 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:31.372734 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:31.372790 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:31.372990 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:31.372992 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:31.372992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:31.373146 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:31.373315 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:31.373380 (+ 65us) server_negotiation.cc:299] Negotiation successful
0809 02:19:31.373448 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":151,"threads_started":1}
Aug 09 02:19:31 dist-test-slave-w206 krb5kdc[15418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241971, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:31.381733 15512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:31.374908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36712 (local address 127.11.93.190:32897)
0809 02:19:31.375004 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:31.375006 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:31.375016 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:19:31.375086 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:31.375087 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:31.375096 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:31.375145 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:31.375604 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:31.376080 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:31.376696 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:31.376870 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:31.376926 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:31.378956 (+ 2030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:31.378958 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:31.378958 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:31.378964 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:31.380526 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:31.380935 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:31.380936 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:31.380936 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:31.381034 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:31.381229 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:31.381229 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:31.381230 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:31.381370 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:31.381450 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:31.381605 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 02:19:31.381668 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
W20260809 02:19:31.381985 15468 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36712
I20260809 02:19:31.382373 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 15535
I20260809 02:19:31.389770 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 15683
I20260809 02:19:31.396008 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 15827
I20260809 02:19:31.401456 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 15432
2026-08-09T02:19:31Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1938 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:19:31 dist-test-slave-w206 krb5kdc[15977](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:19:31 dist-test-slave-w206 krb5kdc[15977](info): set up 2 sockets
Aug 09 02:19:31 dist-test-slave-w206 krb5kdc[15977](info): commencing operation
krb5kdc: starting...
W20260809 02:19:32.471174 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.048s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:19:32 dist-test-slave-w206 krb5kdc[15977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241972, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:19:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:19:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:19:32.598410 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:33117
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:33117
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:32.680789 15990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:32.681003 15990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:32.681026 15990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:32.682240 15990 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:19:32.682283 15990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:32.682298 15990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:32.682312 15990 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:19:32.682323 15990 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:19:32.683925 15990 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:33117
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:33117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15990
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:32.684170 15990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:32.684417 15990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:32.689363 15998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:32.689363 15995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:32.689482 15996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:32.689821 15990 server_base.cc:1034] running on GCE node
I20260809 02:19:32.690060 15990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:32.690336 15990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:32.691543 15990 hybrid_clock.cc:648] HybridClock initialized: now 1786241972691514 us; error 38 us; skew 500 ppm
Aug 09 02:19:32 dist-test-slave-w206 krb5kdc[15977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241972, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:32.694664 15990 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:19:32.695118 15990 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:32.695173 15990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:32.695312 15990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:32.696404 15990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "8eda2df2b5314f98a141fd5975ca3349"
format_stamp: "Formatted at 2026-08-09 02:19:32 on dist-test-slave-w206"
server_key: "8a5edb34bf3cb96dfa4d30d75c4fc021"
server_key_iv: "c0a8e0a8ad899417d1922deda14e14d8"
server_key_version: "encryptionkey@0"
I20260809 02:19:32.696781 15990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "8eda2df2b5314f98a141fd5975ca3349"
format_stamp: "Formatted at 2026-08-09 02:19:32 on dist-test-slave-w206"
server_key: "8a5edb34bf3cb96dfa4d30d75c4fc021"
server_key_iv: "c0a8e0a8ad899417d1922deda14e14d8"
server_key_version: "encryptionkey@0"
I20260809 02:19:32.698446 15990 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:19:32.699478 16004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:32.699653 15990 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 02:19:32.699743 15990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "8eda2df2b5314f98a141fd5975ca3349"
format_stamp: "Formatted at 2026-08-09 02:19:32 on dist-test-slave-w206"
server_key: "8a5edb34bf3cb96dfa4d30d75c4fc021"
server_key_iv: "c0a8e0a8ad899417d1922deda14e14d8"
server_key_version: "encryptionkey@0"
I20260809 02:19:32.699819 15990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:32.720854 15990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:32.723335 15990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:32.723451 15990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:32.727366 15990 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:33117
I20260809 02:19:32.727396 16057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:33117 every 8 connection(s)
I20260809 02:19:32.727723 15990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:19:32.728888 16058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:32.731544 16058 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349: Bootstrap starting.
I20260809 02:19:32.732198 16058 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:32.732577 16058 log.cc:824] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:32.733306 16058 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349: No bootstrap required, opened a new log
I20260809 02:19:32.734020 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 15990
I20260809 02:19:32.734141 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:19:32.734359 11638 external_mini_cluster.cc:1428] Setting key a074f11e95169347d0671afd7665ea0b
I20260809 02:19:32.736116 16058 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eda2df2b5314f98a141fd5975ca3349" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33117 } }
I20260809 02:19:32.736302 16058 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:32.736362 16058 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eda2df2b5314f98a141fd5975ca3349, State: Initialized, Role: FOLLOWER
I20260809 02:19:32.736526 16058 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eda2df2b5314f98a141fd5975ca3349" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33117 } }
I20260809 02:19:32.736608 16058 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:19:32.736632 16058 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:19:32.736706 16058 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:32.737298 16058 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eda2df2b5314f98a141fd5975ca3349" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33117 } }
I20260809 02:19:32.737391 16058 leader_election.cc:302] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8eda2df2b5314f98a141fd5975ca3349; no voters:
I20260809 02:19:32.737627 16058 leader_election.cc:288] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:19:32.737659 16063 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:32.737870 16063 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349 [term 1 LEADER]: Becoming Leader. State: Replica: 8eda2df2b5314f98a141fd5975ca3349, State: Running, Role: LEADER
I20260809 02:19:32.738013 16058 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:19:32.737993 16063 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eda2df2b5314f98a141fd5975ca3349" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33117 } }
I20260809 02:19:32.738397 16063 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8eda2df2b5314f98a141fd5975ca3349. Latest consensus state: current_term: 1 leader_uuid: "8eda2df2b5314f98a141fd5975ca3349" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eda2df2b5314f98a141fd5975ca3349" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33117 } } }
I20260809 02:19:32.738476 16063 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349 [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:32.739162 16064 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8eda2df2b5314f98a141fd5975ca3349" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8eda2df2b5314f98a141fd5975ca3349" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33117 } } }
I20260809 02:19:32.739291 16064 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349 [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:32.739640 16075 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:19:32.740233 16075 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:19:32.742018 16075 catalog_manager.cc:1347] Generated new cluster ID: 6f2d0da796ab4a0f8e9ce28d752a623c
I20260809 02:19:32.742074 16075 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 02:19:32 dist-test-slave-w206 krb5kdc[15977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241972, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:32.746369 16062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:32.734921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39800 (local address 127.11.93.190:33117)
0809 02:19:32.735137 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:32.735145 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:32.735169 (+ 24us) server_negotiation.cc:407] Connection header received
0809 02:19:32.736013 (+ 844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:32.736033 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:32.736081 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:32.736226 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:32.737016 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:32.738129 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:32.739245 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:32.739934 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:32.740083 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:32.742886 (+ 2803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:32.742890 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:32.742890 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:32.742902 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:32.744696 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:32.745081 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:32.745083 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:32.745084 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:32.745173 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:32.745387 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:32.745388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:32.745389 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:32.745621 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:32.745790 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:32.745896 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 02:19:32.746035 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":120,"threads_started":1}
I20260809 02:19:32.762354 16075 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:19:32.762939 16075 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:19:32.767921 16075 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349: Generated new TSK 0
I20260809 02:19:32.768118 16075 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.93.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
I20260809 02:19:32.808014 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:33117
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:32.910033 16087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:32.910246 16087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:32.910270 16087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:32.911398 16087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:32.911437 16087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:32.911463 16087 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:19:32.912890 16087 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:33117
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16087
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:32.913065 16087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:32.913292 16087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:32.918294 16094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:32.918305 16093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:32.918370 16096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:32.918335 16087 server_base.cc:1034] running on GCE node
I20260809 02:19:32.918756 16087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:32.918955 16087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:32.920193 16087 hybrid_clock.cc:648] HybridClock initialized: now 1786241972920184 us; error 30 us; skew 500 ppm
Aug 09 02:19:32 dist-test-slave-w206 krb5kdc[15977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241972, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:32.922813 16087 init.cc:377] Logged in from keytab as kudu/127.11.93.129@KRBTEST.COM (short username kudu)
I20260809 02:19:32.923243 16087 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:32.923317 16087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:32.923461 16087 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:32.924551 16087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "0d30ef69a3654494a38fd22520da5da5"
format_stamp: "Formatted at 2026-08-09 02:19:32 on dist-test-slave-w206"
server_key: "f6cfd3a49897ef592686be543ca05257"
server_key_iv: "44157342e7d240e2e8d94cf562e8ac51"
server_key_version: "encryptionkey@0"
I20260809 02:19:32.924937 16087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "0d30ef69a3654494a38fd22520da5da5"
format_stamp: "Formatted at 2026-08-09 02:19:32 on dist-test-slave-w206"
server_key: "f6cfd3a49897ef592686be543ca05257"
server_key_iv: "44157342e7d240e2e8d94cf562e8ac51"
server_key_version: "encryptionkey@0"
I20260809 02:19:32.926226 16087 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:19:32.926904 16102 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:32.927085 16087 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:32.927184 16087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "0d30ef69a3654494a38fd22520da5da5"
format_stamp: "Formatted at 2026-08-09 02:19:32 on dist-test-slave-w206"
server_key: "f6cfd3a49897ef592686be543ca05257"
server_key_iv: "44157342e7d240e2e8d94cf562e8ac51"
server_key_version: "encryptionkey@0"
I20260809 02:19:32.927269 16087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:32.947883 16087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:32.949883 16087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:32.950060 16087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:32.950307 16087 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:32.950654 16087 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:32.950708 16087 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:32.950764 16087 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:32.950789 16087 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:32.956934 16087 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:39097
I20260809 02:19:32.956976 16220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:39097 every 8 connection(s)
I20260809 02:19:32.957242 16087 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
Aug 09 02:19:32 dist-test-slave-w206 krb5kdc[15977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241972, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:32.964656 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 16087
I20260809 02:19:32.964792 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:19:32.964980 11638 external_mini_cluster.cc:1428] Setting key dce5f98eb2bdc5730cac947e168a787d
I20260809 02:19:32.967078 16062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:32.957964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:35807 (local address 127.11.93.190:33117)
0809 02:19:32.958034 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:32.958036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:32.958272 (+ 236us) server_negotiation.cc:407] Connection header received
0809 02:19:32.958745 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:32.958746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:32.958756 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:32.958814 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:32.959838 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:32.960346 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:32.961353 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:32.961550 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:32.961601 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:32.963842 (+ 2241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:32.963844 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:32.963844 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:32.963852 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:32.965468 (+ 1616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:32.965997 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:32.965998 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:32.965998 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:32.966051 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:32.966390 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:32.966391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:32.966391 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:32.966491 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:32.966542 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:32.966874 (+ 332us) server_negotiation.cc:299] Negotiation successful
0809 02:19:32.966947 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:19:32.967350 16224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:32.957932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:33117 (local address 127.11.93.129:35807)
0809 02:19:32.958123 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:32.958167 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:32.958656 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:32.958880 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:32.958883 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:32.959214 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:32.959749 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:32.959755 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:32.960454 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:32.960455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:32.961274 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:32.961277 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:32.961631 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:32.961632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:32.961738 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:32.962235 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:32.962244 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:32.963749 (+ 1505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:32.965551 (+ 1802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:32.965557 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:32.965559 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:32.965919 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:32.966122 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:32.966123 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:32.966123 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:32.966313 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:32.966556 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:32.966563 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:32.966740 (+ 177us) client_negotiation.cc:769] Sending connection context
0809 02:19:32.966854 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 02:19:32.967055 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":114,"threads_started":1}
I20260809 02:19:32.967835 16221 heartbeater.cc:347] Connected to a master server at 127.11.93.190:33117
I20260809 02:19:32.967947 16221 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:32.968104 16221 heartbeater.cc:511] Master 127.11.93.190:33117 requested a full tablet report, sending...
I20260809 02:19:32.968675 16021 ts_manager.cc:194] Registered new tserver with Master: 0d30ef69a3654494a38fd22520da5da5 (127.11.93.129:39097)
I20260809 02:19:32.969606 16021 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:35807
WARNING: no policy specified for kudu/127.11.93.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
I20260809 02:19:32.993693 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:33117
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:33.075296 16227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:33.075496 16227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:33.075520 16227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:33.076678 16227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:33.076716 16227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:33.076743 16227 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:19:33.078251 16227 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:33117
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16227
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:33.078496 16227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:33.078724 16227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:33.083622 16233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:33.083650 16232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:33.083671 16235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:33.083904 16227 server_base.cc:1034] running on GCE node
I20260809 02:19:33.084157 16227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:33.084405 16227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:33.085565 16227 hybrid_clock.cc:648] HybridClock initialized: now 1786241973085543 us; error 39 us; skew 500 ppm
Aug 09 02:19:33 dist-test-slave-w206 krb5kdc[15977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241973, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:33.088232 16227 init.cc:377] Logged in from keytab as kudu/127.11.93.130@KRBTEST.COM (short username kudu)
I20260809 02:19:33.088677 16227 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:33.088757 16227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:33.088917 16227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:33.090022 16227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "3a9c8023ec3946a0a278a11d536d7362"
format_stamp: "Formatted at 2026-08-09 02:19:33 on dist-test-slave-w206"
server_key: "d5ff91fa548930676e346109d924ed92"
server_key_iv: "b23b943002b8f81efe6802717a21bc08"
server_key_version: "encryptionkey@0"
I20260809 02:19:33.090410 16227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "3a9c8023ec3946a0a278a11d536d7362"
format_stamp: "Formatted at 2026-08-09 02:19:33 on dist-test-slave-w206"
server_key: "d5ff91fa548930676e346109d924ed92"
server_key_iv: "b23b943002b8f81efe6802717a21bc08"
server_key_version: "encryptionkey@0"
I20260809 02:19:33.091853 16227 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:19:33.092628 16241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:33.092808 16227 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:33.092909 16227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "3a9c8023ec3946a0a278a11d536d7362"
format_stamp: "Formatted at 2026-08-09 02:19:33 on dist-test-slave-w206"
server_key: "d5ff91fa548930676e346109d924ed92"
server_key_iv: "b23b943002b8f81efe6802717a21bc08"
server_key_version: "encryptionkey@0"
I20260809 02:19:33.092989 16227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:33.112406 16227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:33.114176 16227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:33.114346 16227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:33.114576 16227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:33.114949 16227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:33.115036 16227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:33.115079 16227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:33.115098 16227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:33.121212 16227 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:44079
I20260809 02:19:33.121332 16362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:44079 every 8 connection(s)
I20260809 02:19:33.121551 16227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
Aug 09 02:19:33 dist-test-slave-w206 krb5kdc[15977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241973, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:33.129117 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 16227
I20260809 02:19:33.129316 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:19:33.129595 11638 external_mini_cluster.cc:1428] Setting key ffd5bbd07ea31a4d441e4b23f30ec7b8
I20260809 02:19:33.131737 16062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:33.122300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:46521 (local address 127.11.93.190:33117)
0809 02:19:33.122391 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:33.122393 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:33.122562 (+ 169us) server_negotiation.cc:407] Connection header received
0809 02:19:33.123153 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:33.123155 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:33.123167 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:33.123225 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:33.124201 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.124718 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.125727 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.125937 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.126021 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:33.128343 (+ 2322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:33.128345 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:33.128345 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:33.128354 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:33.130108 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:33.130606 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:33.130608 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:33.130608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:33.130672 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:33.131065 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:33.131066 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:33.131067 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:33.131191 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:33.131267 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:33.131569 (+ 302us) server_negotiation.cc:299] Negotiation successful
0809 02:19:33.131650 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 02:19:33.131956 16365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:33.122214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:33117 (local address 127.11.93.130:46521)
0809 02:19:33.122424 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:33.122476 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:33.123038 (+ 562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:33.123347 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:33.123350 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:33.123606 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:33.124099 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:33.124104 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.124816 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.124818 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:33.125610 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:33.125612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.126035 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.126036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:33.126173 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:33.126635 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:33.126644 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:33.128214 (+ 1570us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:33.130193 (+ 1979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:33.130199 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:33.130200 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:33.130522 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:33.130749 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:33.130750 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:33.130750 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:33.130953 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:33.131269 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:33.131277 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:33.131435 (+ 158us) client_negotiation.cc:769] Sending connection context
0809 02:19:33.131534 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 02:19:33.131690 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":93,"threads_started":1}
I20260809 02:19:33.132550 16363 heartbeater.cc:347] Connected to a master server at 127.11.93.190:33117
I20260809 02:19:33.132659 16363 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:33.132820 16363 heartbeater.cc:511] Master 127.11.93.190:33117 requested a full tablet report, sending...
I20260809 02:19:33.133190 16021 ts_manager.cc:194] Registered new tserver with Master: 3a9c8023ec3946a0a278a11d536d7362 (127.11.93.130:44079)
I20260809 02:19:33.133687 16021 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:46521
WARNING: no policy specified for kudu/127.11.93.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
I20260809 02:19:33.158788 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:33117
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:33.241374 16368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:33.241571 16368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:33.241595 16368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:33.242687 16368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:33.242727 16368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:33.242754 16368 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:19:33.244302 16368 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:33117
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16368
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:33.244489 16368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:33.244661 16368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:33.249716 16373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:33.249728 16376 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:33.249876 16368 server_base.cc:1034] running on GCE node
W20260809 02:19:33.249967 16374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:33.250278 16368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:33.250492 16368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:33.251641 16368 hybrid_clock.cc:648] HybridClock initialized: now 1786241973251620 us; error 36 us; skew 500 ppm
Aug 09 02:19:33 dist-test-slave-w206 krb5kdc[15977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241973, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:33.254308 16368 init.cc:377] Logged in from keytab as kudu/127.11.93.131@KRBTEST.COM (short username kudu)
I20260809 02:19:33.254699 16368 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:33.254751 16368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:33.254904 16368 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:33.256023 16368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "cf3857028e9c4b0391e5c64aae0df86d"
format_stamp: "Formatted at 2026-08-09 02:19:33 on dist-test-slave-w206"
server_key: "0cee4954d713d563271147d956ad9f19"
server_key_iv: "b22d379f08edfe5901654911c2223349"
server_key_version: "encryptionkey@0"
I20260809 02:19:33.256381 16368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "cf3857028e9c4b0391e5c64aae0df86d"
format_stamp: "Formatted at 2026-08-09 02:19:33 on dist-test-slave-w206"
server_key: "0cee4954d713d563271147d956ad9f19"
server_key_iv: "b22d379f08edfe5901654911c2223349"
server_key_version: "encryptionkey@0"
I20260809 02:19:33.257663 16368 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:19:33.258366 16382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:33.258558 16368 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:19:33.258666 16368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "cf3857028e9c4b0391e5c64aae0df86d"
format_stamp: "Formatted at 2026-08-09 02:19:33 on dist-test-slave-w206"
server_key: "0cee4954d713d563271147d956ad9f19"
server_key_iv: "b22d379f08edfe5901654911c2223349"
server_key_version: "encryptionkey@0"
I20260809 02:19:33.258741 16368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:33.280714 16368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:33.282686 16368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:33.282856 16368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:33.283166 16368 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:33.283507 16368 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:33.283564 16368 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:33.283599 16368 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:33.283627 16368 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:33.289598 16368 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:33519
I20260809 02:19:33.289640 16499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:33519 every 8 connection(s)
I20260809 02:19:33.289901 16368 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:19:33.294325 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 16368
I20260809 02:19:33.294443 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:19:33.294622 11638 external_mini_cluster.cc:1428] Setting key 26c4637efd39ff490d3b6df37c87b533
Aug 09 02:19:33 dist-test-slave-w206 krb5kdc[15977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241973, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:33.299422 16062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:33.290596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:37583 (local address 127.11.93.190:33117)
0809 02:19:33.290678 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:33.290681 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:33.290865 (+ 184us) server_negotiation.cc:407] Connection header received
0809 02:19:33.291447 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:33.291449 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:33.291462 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:33.291516 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:33.292482 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.292990 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.294000 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.294218 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.294305 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:33.296862 (+ 2557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:33.296864 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:33.296864 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:33.296871 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:33.298112 (+ 1241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:33.298510 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:33.298512 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:33.298512 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:33.298570 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:33.298798 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:33.298798 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:33.298799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:33.298908 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:33.298962 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:33.299286 (+ 324us) server_negotiation.cc:299] Negotiation successful
0809 02:19:33.299355 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 02:19:33.299556 16503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:33.290575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:33117 (local address 127.11.93.131:37583)
0809 02:19:33.290744 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:33.290781 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:33.291333 (+ 552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:33.291584 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:33.291588 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:33.291861 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:33.292367 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:33.292372 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.293090 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.293091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:33.293894 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:33.293896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.294317 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.294318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:33.294472 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:33.295045 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:33.295071 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:33.296771 (+ 1700us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:33.298185 (+ 1414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:33.298191 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:33.298192 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:33.298414 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:33.298641 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:33.298641 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:33.298642 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:33.298740 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:33.298967 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:33.299006 (+ 39us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:33.299147 (+ 141us) client_negotiation.cc:769] Sending connection context
0809 02:19:33.299236 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 02:19:33.299358 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":76,"threads_started":1}
I20260809 02:19:33.300015 16500 heartbeater.cc:347] Connected to a master server at 127.11.93.190:33117
I20260809 02:19:33.300112 16500 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:33.300233 16500 heartbeater.cc:511] Master 127.11.93.190:33117 requested a full tablet report, sending...
I20260809 02:19:33.300597 16021 ts_manager.cc:194] Registered new tserver with Master: cf3857028e9c4b0391e5c64aae0df86d (127.11.93.131:33519)
I20260809 02:19:33.300932 16021 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:37583
I20260809 02:19:33.306314 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:19:33.313727 16062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:33.307681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39802 (local address 127.11.93.190:33117)
0809 02:19:33.307772 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:33.307774 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:33.307861 (+ 87us) server_negotiation.cc:407] Connection header received
0809 02:19:33.307928 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:33.307929 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:33.307939 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:33.308012 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:33.308587 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.309058 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.309801 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.309989 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.310076 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:33.311294 (+ 1218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:33.311296 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:33.311296 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:33.311304 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:33.312453 (+ 1149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:33.312851 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:33.312852 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:33.312852 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:33.312914 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:33.313118 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:33.313119 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:33.313119 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:33.313303 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:33.313419 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:33.313543 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 02:19:33.313622 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 02:19:33.315164 16021 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39802:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:19:33.316686 16021 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:19:33.323302 16515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:33.319056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45776 (local address 127.11.93.129:39097)
0809 02:19:33.319352 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:33.319356 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:33.319544 (+ 188us) server_negotiation.cc:407] Connection header received
0809 02:19:33.319591 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:33.319593 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:33.319607 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:33.319683 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:33.319950 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.321018 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.322291 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.322813 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.322909 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:33.322970 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:33.323163 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 02:19:33.323207 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":91,"threads_started":1}
I20260809 02:19:33.323303 16516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:33.318931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:44079 (local address 127.0.0.1:56338)
0809 02:19:33.319261 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:33.319297 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:33.319363 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:33.319714 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:33.319716 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:33.319719 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:33.319810 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:33.319812 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.321147 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.321147 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:33.322026 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:33.322028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.323029 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.323031 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:33.323098 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:33.323102 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:19:33.323154 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 02:19:33.323212 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":6,"thread_start_us":113,"threads_started":1}
I20260809 02:19:33.323307 16512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:33.318928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:39097 (local address 127.0.0.1:45776)
0809 02:19:33.319114 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:33.319457 (+ 343us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:33.319527 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:33.319713 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:33.319716 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:33.319718 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:33.319799 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:33.319801 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.321128 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.321129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:33.322187 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:33.322189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.322914 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.322915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:33.323026 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:33.323041 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 02:19:33.323144 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 02:19:33.323206 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":54,"thread_start_us":79,"threads_started":1}
I20260809 02:19:33.323526 16513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:33.319160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:33519 (local address 127.0.0.1:34020)
0809 02:19:33.319265 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:33.319297 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:33.319363 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:33.319713 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:33.319725 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:33.319727 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:33.319799 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:33.319801 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.320780 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.320781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:33.322004 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:33.322007 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.323032 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.323033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:33.323104 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:33.323108 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:19:33.323154 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 02:19:33.323212 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"mutex_wait_us":10,"thread_start_us":60,"threads_started":1}
I20260809 02:19:33.323658 16517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:33.319305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34020 (local address 127.11.93.131:33519)
0809 02:19:33.319458 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:33.319462 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:33.319473 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:19:33.319513 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:33.319515 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:33.319531 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:33.319606 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:33.319888 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.320647 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.322093 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.322835 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.322911 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:33.322997 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:33.323258 (+ 261us) server_negotiation.cc:299] Negotiation successful
0809 02:19:33.323301 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":91,"threads_started":1}
I20260809 02:19:33.323915 16514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:33.319054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56338 (local address 127.11.93.130:44079)
0809 02:19:33.319273 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:33.319278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:33.319453 (+ 175us) server_negotiation.cc:407] Connection header received
0809 02:19:33.319501 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:33.319523 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:33.319540 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:33.319613 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:33.319917 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.321046 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.322134 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.322835 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.322916 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:33.322990 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:33.323774 (+ 784us) server_negotiation.cc:299] Negotiation successful
0809 02:19:33.323825 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":86,"threads_started":1}
I20260809 02:19:33.324100 16152 tablet_service.cc:1467] Processing CreateTablet for tablet eebaf569b8b64cb88153807b930c6684 (DEFAULT_TABLE table=test-table [id=8f678c189e144277a632993f53186df8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:33.324304 16432 tablet_service.cc:1467] Processing CreateTablet for tablet eebaf569b8b64cb88153807b930c6684 (DEFAULT_TABLE table=test-table [id=8f678c189e144277a632993f53186df8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:33.324501 16152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eebaf569b8b64cb88153807b930c6684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:33.324430 16292 tablet_service.cc:1467] Processing CreateTablet for tablet eebaf569b8b64cb88153807b930c6684 (DEFAULT_TABLE table=test-table [id=8f678c189e144277a632993f53186df8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:33.324661 16432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eebaf569b8b64cb88153807b930c6684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:33.324685 16292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eebaf569b8b64cb88153807b930c6684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:33.327543 16518 tablet_bootstrap.cc:492] T eebaf569b8b64cb88153807b930c6684 P 0d30ef69a3654494a38fd22520da5da5: Bootstrap starting.
I20260809 02:19:33.327911 16519 tablet_bootstrap.cc:492] T eebaf569b8b64cb88153807b930c6684 P 3a9c8023ec3946a0a278a11d536d7362: Bootstrap starting.
I20260809 02:19:33.328125 16520 tablet_bootstrap.cc:492] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d: Bootstrap starting.
I20260809 02:19:33.328308 16518 tablet_bootstrap.cc:654] T eebaf569b8b64cb88153807b930c6684 P 0d30ef69a3654494a38fd22520da5da5: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:33.328645 16519 tablet_bootstrap.cc:654] T eebaf569b8b64cb88153807b930c6684 P 3a9c8023ec3946a0a278a11d536d7362: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:33.328795 16520 tablet_bootstrap.cc:654] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:33.329026 16518 log.cc:824] T eebaf569b8b64cb88153807b930c6684 P 0d30ef69a3654494a38fd22520da5da5: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:33.329303 16519 log.cc:824] T eebaf569b8b64cb88153807b930c6684 P 3a9c8023ec3946a0a278a11d536d7362: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:33.329416 16520 log.cc:824] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:33.330049 16518 tablet_bootstrap.cc:492] T eebaf569b8b64cb88153807b930c6684 P 0d30ef69a3654494a38fd22520da5da5: No bootstrap required, opened a new log
I20260809 02:19:33.330118 16518 ts_tablet_manager.cc:1397] T eebaf569b8b64cb88153807b930c6684 P 0d30ef69a3654494a38fd22520da5da5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 02:19:33.330143 16520 tablet_bootstrap.cc:492] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d: No bootstrap required, opened a new log
I20260809 02:19:33.330204 16520 ts_tablet_manager.cc:1397] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:19:33.330207 16519 tablet_bootstrap.cc:492] T eebaf569b8b64cb88153807b930c6684 P 3a9c8023ec3946a0a278a11d536d7362: No bootstrap required, opened a new log
I20260809 02:19:33.330313 16519 ts_tablet_manager.cc:1397] T eebaf569b8b64cb88153807b930c6684 P 3a9c8023ec3946a0a278a11d536d7362: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:19:33.331770 16519 raft_consensus.cc:348] T eebaf569b8b64cb88153807b930c6684 P 3a9c8023ec3946a0a278a11d536d7362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d30ef69a3654494a38fd22520da5da5" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 39097 } } peers { permanent_uuid: "3a9c8023ec3946a0a278a11d536d7362" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 44079 } } peers { permanent_uuid: "cf3857028e9c4b0391e5c64aae0df86d" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 33519 } }
I20260809 02:19:33.331899 16519 raft_consensus.cc:374] T eebaf569b8b64cb88153807b930c6684 P 3a9c8023ec3946a0a278a11d536d7362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:33.331920 16519 raft_consensus.cc:729] T eebaf569b8b64cb88153807b930c6684 P 3a9c8023ec3946a0a278a11d536d7362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9c8023ec3946a0a278a11d536d7362, State: Initialized, Role: FOLLOWER
I20260809 02:19:33.332039 16519 consensus_queue.cc:260] T eebaf569b8b64cb88153807b930c6684 P 3a9c8023ec3946a0a278a11d536d7362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d30ef69a3654494a38fd22520da5da5" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 39097 } } peers { permanent_uuid: "3a9c8023ec3946a0a278a11d536d7362" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 44079 } } peers { permanent_uuid: "cf3857028e9c4b0391e5c64aae0df86d" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 33519 } }
I20260809 02:19:33.332157 16518 raft_consensus.cc:348] T eebaf569b8b64cb88153807b930c6684 P 0d30ef69a3654494a38fd22520da5da5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d30ef69a3654494a38fd22520da5da5" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 39097 } } peers { permanent_uuid: "3a9c8023ec3946a0a278a11d536d7362" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 44079 } } peers { permanent_uuid: "cf3857028e9c4b0391e5c64aae0df86d" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 33519 } }
I20260809 02:19:33.332157 16520 raft_consensus.cc:348] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d30ef69a3654494a38fd22520da5da5" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 39097 } } peers { permanent_uuid: "3a9c8023ec3946a0a278a11d536d7362" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 44079 } } peers { permanent_uuid: "cf3857028e9c4b0391e5c64aae0df86d" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 33519 } }
I20260809 02:19:33.332309 16520 raft_consensus.cc:374] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:33.332306 16518 raft_consensus.cc:374] T eebaf569b8b64cb88153807b930c6684 P 0d30ef69a3654494a38fd22520da5da5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:33.332314 16363 heartbeater.cc:503] Master 127.11.93.190:33117 was elected leader, sending a full tablet report...
I20260809 02:19:33.332342 16520 raft_consensus.cc:729] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf3857028e9c4b0391e5c64aae0df86d, State: Initialized, Role: FOLLOWER
I20260809 02:19:33.332342 16518 raft_consensus.cc:729] T eebaf569b8b64cb88153807b930c6684 P 0d30ef69a3654494a38fd22520da5da5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d30ef69a3654494a38fd22520da5da5, State: Initialized, Role: FOLLOWER
I20260809 02:19:33.332449 16520 consensus_queue.cc:260] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d30ef69a3654494a38fd22520da5da5" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 39097 } } peers { permanent_uuid: "3a9c8023ec3946a0a278a11d536d7362" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 44079 } } peers { permanent_uuid: "cf3857028e9c4b0391e5c64aae0df86d" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 33519 } }
I20260809 02:19:33.332449 16518 consensus_queue.cc:260] T eebaf569b8b64cb88153807b930c6684 P 0d30ef69a3654494a38fd22520da5da5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d30ef69a3654494a38fd22520da5da5" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 39097 } } peers { permanent_uuid: "3a9c8023ec3946a0a278a11d536d7362" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 44079 } } peers { permanent_uuid: "cf3857028e9c4b0391e5c64aae0df86d" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 33519 } }
I20260809 02:19:33.332314 16519 ts_tablet_manager.cc:1428] T eebaf569b8b64cb88153807b930c6684 P 3a9c8023ec3946a0a278a11d536d7362: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:19:33.332710 16520 ts_tablet_manager.cc:1428] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 02:19:33.332710 16518 ts_tablet_manager.cc:1428] T eebaf569b8b64cb88153807b930c6684 P 0d30ef69a3654494a38fd22520da5da5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 02:19:33.332849 16500 heartbeater.cc:503] Master 127.11.93.190:33117 was elected leader, sending a full tablet report...
I20260809 02:19:33.333076 16221 heartbeater.cc:503] Master 127.11.93.190:33117 was elected leader, sending a full tablet report...
W20260809 02:19:33.372092 16364 tablet.cc:2369] T eebaf569b8b64cb88153807b930c6684 P 3a9c8023ec3946a0a278a11d536d7362: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:19:33.431070 16528 raft_consensus.cc:482] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:19:33.431195 16528 raft_consensus.cc:504] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d30ef69a3654494a38fd22520da5da5" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 39097 } } peers { permanent_uuid: "3a9c8023ec3946a0a278a11d536d7362" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 44079 } } peers { permanent_uuid: "cf3857028e9c4b0391e5c64aae0df86d" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 33519 } }
I20260809 02:19:33.431537 16528 leader_election.cc:288] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d30ef69a3654494a38fd22520da5da5 (127.11.93.129:39097), 3a9c8023ec3946a0a278a11d536d7362 (127.11.93.130:44079)
I20260809 02:19:33.434489 16529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:33.431737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:44079 (local address 127.11.93.131:54775)
0809 02:19:33.431947 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:33.431956 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:33.432005 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:33.432160 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:33.432161 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:33.432163 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:33.432238 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:33.432240 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.432859 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.432860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:33.433659 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:33.433662 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.434219 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.434220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:33.434298 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:33.434302 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:19:33.434345 (+ 43us) client_negotiation.cc:240] Negotiation successful
0809 02:19:33.434374 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"mutex_wait_us":1,"thread_start_us":125,"threads_started":1}
I20260809 02:19:33.434496 16514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:33.431834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:54775 (local address 127.11.93.130:44079)
0809 02:19:33.431909 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:33.431911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:33.432011 (+ 100us) server_negotiation.cc:407] Connection header received
0809 02:19:33.432051 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:33.432052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:33.432063 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:33.432138 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:33.432309 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.432752 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.433746 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.434130 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.434186 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:33.434216 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:33.434369 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 02:19:33.434423 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:19:33.434551 16515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:33.431748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:34713 (local address 127.11.93.129:39097)
0809 02:19:33.431794 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:33.431796 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:33.431812 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:19:33.431904 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:33.431905 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:33.431917 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:33.431978 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:33.432185 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.432735 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.433799 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.434138 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.434237 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:33.434245 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:33.434434 (+ 189us) server_negotiation.cc:299] Negotiation successful
0809 02:19:33.434473 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 02:19:33.434573 16503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:33.431689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:39097 (local address 127.11.93.131:34713)
0809 02:19:33.431764 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:33.431778 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:33.431830 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:33.432015 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:33.432017 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:33.432019 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:33.432104 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:33.432107 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.432823 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.432824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:33.433668 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:33.433671 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.434247 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.434248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:33.434347 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:33.434351 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:19:33.434410 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 02:19:33.434446 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":81}
I20260809 02:19:33.434937 16173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eebaf569b8b64cb88153807b930c6684" candidate_uuid: "cf3857028e9c4b0391e5c64aae0df86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d30ef69a3654494a38fd22520da5da5" is_pre_election: true
I20260809 02:19:33.435151 16173 raft_consensus.cc:2454] T eebaf569b8b64cb88153807b930c6684 P 0d30ef69a3654494a38fd22520da5da5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf3857028e9c4b0391e5c64aae0df86d in term 0.
I20260809 02:19:33.435120 16312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eebaf569b8b64cb88153807b930c6684" candidate_uuid: "cf3857028e9c4b0391e5c64aae0df86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9c8023ec3946a0a278a11d536d7362" is_pre_election: true
I20260809 02:19:33.435282 16312 raft_consensus.cc:2454] T eebaf569b8b64cb88153807b930c6684 P 3a9c8023ec3946a0a278a11d536d7362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf3857028e9c4b0391e5c64aae0df86d in term 0.
I20260809 02:19:33.435441 16384 leader_election.cc:302] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d30ef69a3654494a38fd22520da5da5, cf3857028e9c4b0391e5c64aae0df86d; no voters:
I20260809 02:19:33.435624 16528 raft_consensus.cc:2781] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:19:33.435668 16528 raft_consensus.cc:482] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:19:33.435683 16528 raft_consensus.cc:3037] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:33.436419 16528 raft_consensus.cc:504] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d30ef69a3654494a38fd22520da5da5" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 39097 } } peers { permanent_uuid: "3a9c8023ec3946a0a278a11d536d7362" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 44079 } } peers { permanent_uuid: "cf3857028e9c4b0391e5c64aae0df86d" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 33519 } }
I20260809 02:19:33.436559 16528 leader_election.cc:288] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d [CANDIDATE]: Term 1 election: Requested vote from peers 0d30ef69a3654494a38fd22520da5da5 (127.11.93.129:39097), 3a9c8023ec3946a0a278a11d536d7362 (127.11.93.130:44079)
I20260809 02:19:33.436697 16173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eebaf569b8b64cb88153807b930c6684" candidate_uuid: "cf3857028e9c4b0391e5c64aae0df86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d30ef69a3654494a38fd22520da5da5"
I20260809 02:19:33.436720 16312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eebaf569b8b64cb88153807b930c6684" candidate_uuid: "cf3857028e9c4b0391e5c64aae0df86d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9c8023ec3946a0a278a11d536d7362"
I20260809 02:19:33.436780 16173 raft_consensus.cc:3037] T eebaf569b8b64cb88153807b930c6684 P 0d30ef69a3654494a38fd22520da5da5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:33.436826 16312 raft_consensus.cc:3037] T eebaf569b8b64cb88153807b930c6684 P 3a9c8023ec3946a0a278a11d536d7362 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:33.437520 16173 raft_consensus.cc:2454] T eebaf569b8b64cb88153807b930c6684 P 0d30ef69a3654494a38fd22520da5da5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf3857028e9c4b0391e5c64aae0df86d in term 1.
I20260809 02:19:33.437677 16384 leader_election.cc:302] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d30ef69a3654494a38fd22520da5da5, cf3857028e9c4b0391e5c64aae0df86d; no voters:
I20260809 02:19:33.437717 16312 raft_consensus.cc:2454] T eebaf569b8b64cb88153807b930c6684 P 3a9c8023ec3946a0a278a11d536d7362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf3857028e9c4b0391e5c64aae0df86d in term 1.
I20260809 02:19:33.437758 16528 raft_consensus.cc:2781] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:33.437914 16528 raft_consensus.cc:686] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d [term 1 LEADER]: Becoming Leader. State: Replica: cf3857028e9c4b0391e5c64aae0df86d, State: Running, Role: LEADER
I20260809 02:19:33.437997 16528 consensus_queue.cc:237] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d30ef69a3654494a38fd22520da5da5" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 39097 } } peers { permanent_uuid: "3a9c8023ec3946a0a278a11d536d7362" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 44079 } } peers { permanent_uuid: "cf3857028e9c4b0391e5c64aae0df86d" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 33519 } }
I20260809 02:19:33.438822 16020 catalog_manager.cc:5495] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d reported cstate change: term changed from 0 to 1, leader changed from <none> to cf3857028e9c4b0391e5c64aae0df86d (127.11.93.131). New cstate: current_term: 1 leader_uuid: "cf3857028e9c4b0391e5c64aae0df86d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d30ef69a3654494a38fd22520da5da5" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 39097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9c8023ec3946a0a278a11d536d7362" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 44079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf3857028e9c4b0391e5c64aae0df86d" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 33519 } health_report { overall_health: HEALTHY } } }
W20260809 02:19:33.457937 16223 tablet.cc:2369] T eebaf569b8b64cb88153807b930c6684 P 0d30ef69a3654494a38fd22520da5da5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:19:33.471398 16517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:33.468849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34036 (local address 127.11.93.131:33519)
0809 02:19:33.468923 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:33.468925 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:33.468935 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:19:33.469006 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:33.469006 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:33.469023 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:33.469101 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:19:33.469263 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.469752 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.470570 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:33.470757 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:33.470831 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:33.471041 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:19:33.471140 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:19:33.471238 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:33.471257 (+ 19us) server_negotiation.cc:299] Negotiation successful
0809 02:19:33.471278 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:19:33.473256 16173 raft_consensus.cc:1261] T eebaf569b8b64cb88153807b930c6684 P 0d30ef69a3654494a38fd22520da5da5 [term 1 FOLLOWER]: Refusing update from remote peer cf3857028e9c4b0391e5c64aae0df86d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:33.473289 16312 raft_consensus.cc:1261] T eebaf569b8b64cb88153807b930c6684 P 3a9c8023ec3946a0a278a11d536d7362 [term 1 FOLLOWER]: Refusing update from remote peer cf3857028e9c4b0391e5c64aae0df86d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:33.473687 16531 consensus_queue.cc:1035] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d30ef69a3654494a38fd22520da5da5" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 39097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:33.473840 16528 consensus_queue.cc:1035] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9c8023ec3946a0a278a11d536d7362" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 44079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:33.476263 16534 mvcc.cc:205] Tried to move back new op lower bound from 7316447123343765504 to 7316447123202686976. Current Snapshot: MvccSnapshot[applied={T|T < 7316447123343765504}]
I20260809 02:19:33.476426 16535 mvcc.cc:205] Tried to move back new op lower bound from 7316447123343765504 to 7316447123202686976. Current Snapshot: MvccSnapshot[applied={T|T < 7316447123343765504}]
I20260809 02:19:33.476858 16536 mvcc.cc:205] Tried to move back new op lower bound from 7316447123343765504 to 7316447123202686976. Current Snapshot: MvccSnapshot[applied={T|T < 7316447123343765504 or (T in {7316447123343765504})}]
I20260809 02:19:33.479326 16019 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:33.479418 16019 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:33.480222 16019 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8eda2df2b5314f98a141fd5975ca3349: Sending DeleteTablet for 3 replicas of tablet eebaf569b8b64cb88153807b930c6684
I20260809 02:19:33.480582 16152 tablet_service.cc:1514] Processing DeleteTablet for tablet eebaf569b8b64cb88153807b930c6684 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:33 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:45776
I20260809 02:19:33.480711 16292 tablet_service.cc:1514] Processing DeleteTablet for tablet eebaf569b8b64cb88153807b930c6684 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:33 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:56338
I20260809 02:19:33.480841 16544 tablet_replica.cc:330] T eebaf569b8b64cb88153807b930c6684 P 0d30ef69a3654494a38fd22520da5da5: stopping tablet replica
I20260809 02:19:33.480933 16544 raft_consensus.cc:2229] T eebaf569b8b64cb88153807b930c6684 P 0d30ef69a3654494a38fd22520da5da5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:33.480919 16432 tablet_service.cc:1514] Processing DeleteTablet for tablet eebaf569b8b64cb88153807b930c6684 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:33 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:34020
I20260809 02:19:33.481038 16544 raft_consensus.cc:2258] T eebaf569b8b64cb88153807b930c6684 P 0d30ef69a3654494a38fd22520da5da5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:33.481163 16546 tablet_replica.cc:330] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d: stopping tablet replica
I20260809 02:19:33.481235 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 16087
I20260809 02:19:33.481343 16546 raft_consensus.cc:2229] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:19:33.481518 16546 raft_consensus.cc:2258] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:33.482553 16546 ts_tablet_manager.cc:1905] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:33.484470 16546 ts_tablet_manager.cc:1918] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:19:33.484555 16546 log.cc:1196] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/eebaf569b8b64cb88153807b930c6684
I20260809 02:19:33.484848 16546 ts_tablet_manager.cc:1939] T eebaf569b8b64cb88153807b930c6684 P cf3857028e9c4b0391e5c64aae0df86d: Deleting consensus metadata
I20260809 02:19:33.485318 16007 catalog_manager.cc:4841] TS cf3857028e9c4b0391e5c64aae0df86d (127.11.93.131:33519): tablet eebaf569b8b64cb88153807b930c6684 (table test-table [id=8f678c189e144277a632993f53186df8]) successfully deleted
I20260809 02:19:33.491123 16545 tablet_replica.cc:330] T eebaf569b8b64cb88153807b930c6684 P 3a9c8023ec3946a0a278a11d536d7362: stopping tablet replica
I20260809 02:19:33.491261 16545 raft_consensus.cc:2229] T eebaf569b8b64cb88153807b930c6684 P 3a9c8023ec3946a0a278a11d536d7362 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:33.491392 16545 raft_consensus.cc:2258] T eebaf569b8b64cb88153807b930c6684 P 3a9c8023ec3946a0a278a11d536d7362 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 02:19:33.491561 16006 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.93.129:39097 (error 108)
I20260809 02:19:33.492100 16516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:33.491980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:39097 (local address 127.0.0.1:45786)
0809 02:19:33.492029 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:33.492063 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.129:39097: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260809 02:19:33.492198 16545 ts_tablet_manager.cc:1905] T eebaf569b8b64cb88153807b930c6684 P 3a9c8023ec3946a0a278a11d536d7362: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:33.492238 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 16227
W20260809 02:19:33.496178 16006 catalog_manager.cc:4584] TS 0d30ef69a3654494a38fd22520da5da5 (127.11.93.129:39097): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet eebaf569b8b64cb88153807b930c6684: Network error: Client connection negotiation failed: client connection to 127.11.93.129:39097: connect: Connection refused (error 111)
I20260809 02:19:33.498817 16516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:33.498685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:44079 (local address 127.0.0.1:56346)
0809 02:19:33.498752 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:33.498783 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.130:44079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 02:19:33.498816 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 16368
I20260809 02:19:33.504534 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 15990
2026-08-09T02:19:33Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2102 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-09T02:19:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:19:33Z Disabled control of system clock
I20260809 02:19:33.534497 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:44567
--webserver_interface=127.11.93.190
--webserver_port=0
--builtin_ntp_servers=127.11.93.148:34479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:44567
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 02:19:33.617194 16551 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:33.617421 16551 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:33.617443 16551 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:33.618635 16551 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:19:33.618676 16551 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:33.618690 16551 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:33.618702 16551 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:19:33.618714 16551 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:19:33.620138 16551 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:34479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:44567
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:44567
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16551
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:33.620342 16551 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:33.620592 16551 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:33.625398 16559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:33.625398 16556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:33.625557 16557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:33.625847 16551 server_base.cc:1034] running on GCE node
I20260809 02:19:33.626122 16551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:33.626416 16551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:33.627581 16551 hybrid_clock.cc:648] HybridClock initialized: now 1786241973627557 us; error 40 us; skew 500 ppm
I20260809 02:19:33.628957 16551 webserver.cc:460] Webserver started at http://127.11.93.190:45927/ using document root <none> and password file <none>
I20260809 02:19:33.629192 16551 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:33.629261 16551 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:33.629417 16551 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:33.630540 16551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "8310febc03f84dd793a09a6b7a4b70f7"
format_stamp: "Formatted at 2026-08-09 02:19:33 on dist-test-slave-w206"
server_key: "0ee60cebb37cf0eca9495925eeff8c11"
server_key_iv: "ddad95a9be913f88b83d54b5a0056afe"
server_key_version: "encryptionkey@0"
I20260809 02:19:33.630923 16551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "8310febc03f84dd793a09a6b7a4b70f7"
format_stamp: "Formatted at 2026-08-09 02:19:33 on dist-test-slave-w206"
server_key: "0ee60cebb37cf0eca9495925eeff8c11"
server_key_iv: "ddad95a9be913f88b83d54b5a0056afe"
server_key_version: "encryptionkey@0"
I20260809 02:19:33.632308 16551 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:33.633090 16565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:33.633283 16551 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:33.633399 16551 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "8310febc03f84dd793a09a6b7a4b70f7"
format_stamp: "Formatted at 2026-08-09 02:19:33 on dist-test-slave-w206"
server_key: "0ee60cebb37cf0eca9495925eeff8c11"
server_key_iv: "ddad95a9be913f88b83d54b5a0056afe"
server_key_version: "encryptionkey@0"
I20260809 02:19:33.633482 16551 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:33.636857 16551 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:33.637128 16551 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:33.637271 16551 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:33.641355 16551 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:44567
I20260809 02:19:33.641393 16622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:44567 every 8 connection(s)
I20260809 02:19:33.641732 16551 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:19:33.642500 16623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:33.645478 16623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7: Bootstrap starting.
I20260809 02:19:33.646139 16623 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:33.646404 16623 log.cc:824] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:33.647141 16623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7: No bootstrap required, opened a new log
I20260809 02:19:33.648841 16623 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8310febc03f84dd793a09a6b7a4b70f7" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 44567 } }
I20260809 02:19:33.648978 16623 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:33.649001 16623 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8310febc03f84dd793a09a6b7a4b70f7, State: Initialized, Role: FOLLOWER
I20260809 02:19:33.649113 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 16551
I20260809 02:19:33.649238 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:19:33.649173 16623 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8310febc03f84dd793a09a6b7a4b70f7" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 44567 } }
I20260809 02:19:33.649286 16623 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:19:33.649333 16623 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:19:33.649387 16623 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:33.649442 11638 external_mini_cluster.cc:1428] Setting key 24cc26c19956dac68363730fc4d5a63b
I20260809 02:19:33.650100 16623 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8310febc03f84dd793a09a6b7a4b70f7" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 44567 } }
I20260809 02:19:33.650223 16623 leader_election.cc:302] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8310febc03f84dd793a09a6b7a4b70f7; no voters:
I20260809 02:19:33.650413 16623 leader_election.cc:288] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:19:33.650465 16628 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:33.650596 16628 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7 [term 1 LEADER]: Becoming Leader. State: Replica: 8310febc03f84dd793a09a6b7a4b70f7, State: Running, Role: LEADER
I20260809 02:19:33.650667 16623 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:19:33.650699 16628 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8310febc03f84dd793a09a6b7a4b70f7" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 44567 } }
I20260809 02:19:33.651917 16630 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8310febc03f84dd793a09a6b7a4b70f7. Latest consensus state: current_term: 1 leader_uuid: "8310febc03f84dd793a09a6b7a4b70f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8310febc03f84dd793a09a6b7a4b70f7" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 44567 } } }
I20260809 02:19:33.652004 16630 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7 [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:33.651996 16627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:33.650001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59306 (local address 127.11.93.190:44567)
0809 02:19:33.650245 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:33.650255 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:33.650289 (+ 34us) server_negotiation.cc:407] Connection header received
0809 02:19:33.650432 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:33.650440 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:33.650489 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:33.650938 (+ 449us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:33.651388 (+ 450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:33.651391 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:33.651392 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:19:33.651395 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:33.651434 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:19:33.651450 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:33.651542 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:33.651620 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 02:19:33.651795 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":100,"threads_started":1}
W20260809 02:19:33.652566 16643 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:19:33.652623 16643 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:19:33.652845 16644 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:19:33.653029 16644 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:19:33.652098 16629 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8310febc03f84dd793a09a6b7a4b70f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8310febc03f84dd793a09a6b7a4b70f7" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 44567 } } }
I20260809 02:19:33.653625 16629 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7 [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:33.654551 16644 catalog_manager.cc:1347] Generated new cluster ID: 9c128517b3314f4892eef51ff61a4d32
I20260809 02:19:33.654593 16644 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:19:33.664119 16644 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:19:33.664288 16644 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:19:33.668923 16644 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7: Generated new TSK 0
I20260809 02:19:33.669158 16644 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:19:33.670918 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:44567
--builtin_ntp_servers=127.11.93.148:34479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 02:19:33.755198 16648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:33.755435 16648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:33.755475 16648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:33.756652 16648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:33.756718 16648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:33.756760 16648 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:19:33.758112 16648 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:34479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:44567
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16648
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:33.758368 16648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:33.758664 16648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:33.764510 16655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:33.764549 16654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:33.764691 16657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:33.764909 16648 server_base.cc:1034] running on GCE node
I20260809 02:19:33.765146 16648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:33.765420 16648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:33.766582 16648 hybrid_clock.cc:648] HybridClock initialized: now 1786241973766564 us; error 34 us; skew 500 ppm
I20260809 02:19:33.768033 16648 webserver.cc:460] Webserver started at http://127.11.93.129:37601/ using document root <none> and password file <none>
I20260809 02:19:33.768296 16648 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:33.768342 16648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:33.768496 16648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:33.769564 16648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "878e9c53d5a34fa5bb257db0e2eacb41"
format_stamp: "Formatted at 2026-08-09 02:19:33 on dist-test-slave-w206"
server_key: "63f80b60de1c116bfc10cb3ffdd9c3e9"
server_key_iv: "73d3e74ec1b591acd5553b95f85529bb"
server_key_version: "encryptionkey@0"
I20260809 02:19:33.769932 16648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "878e9c53d5a34fa5bb257db0e2eacb41"
format_stamp: "Formatted at 2026-08-09 02:19:33 on dist-test-slave-w206"
server_key: "63f80b60de1c116bfc10cb3ffdd9c3e9"
server_key_iv: "73d3e74ec1b591acd5553b95f85529bb"
server_key_version: "encryptionkey@0"
I20260809 02:19:33.771306 16648 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:19:33.772133 16663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:33.772352 16648 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:19:33.772450 16648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "878e9c53d5a34fa5bb257db0e2eacb41"
format_stamp: "Formatted at 2026-08-09 02:19:33 on dist-test-slave-w206"
server_key: "63f80b60de1c116bfc10cb3ffdd9c3e9"
server_key_iv: "73d3e74ec1b591acd5553b95f85529bb"
server_key_version: "encryptionkey@0"
I20260809 02:19:33.772533 16648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:33.775926 16648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:33.776206 16648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:33.776348 16648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:33.776585 16648 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:33.776940 16648 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:33.776994 16648 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:33.777036 16648 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:33.777062 16648 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:33.784070 16648 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:33749
I20260809 02:19:33.784111 16782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:33749 every 8 connection(s)
I20260809 02:19:33.784438 16648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:19:33.787328 16627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:33.785160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:56853 (local address 127.11.93.190:44567)
0809 02:19:33.785279 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:33.785281 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:33.785419 (+ 138us) server_negotiation.cc:407] Connection header received
0809 02:19:33.785849 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:33.785850 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:33.785856 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:33.785930 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:33.787139 (+ 1209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:33.787140 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:33.787140 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:19:33.787143 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:33.787158 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:19:33.787162 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:33.787222 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:33.787265 (+ 43us) server_negotiation.cc:299] Negotiation successful
0809 02:19:33.787277 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260809 02:19:33.787546 16785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:33.785084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:44567 (local address 127.11.93.129:56853)
0809 02:19:33.785287 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:33.785328 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:33.785768 (+ 440us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:33.785981 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:33.785984 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:33.785992 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:33.786947 (+ 955us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:19:33.786948 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:33.787020 (+ 72us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:19:33.787059 (+ 39us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:33.787216 (+ 157us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:33.787218 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:33.787221 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:19:33.787271 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 02:19:33.787316 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":85,"threads_started":1}
I20260809 02:19:33.788110 16783 heartbeater.cc:347] Connected to a master server at 127.11.93.190:44567
I20260809 02:19:33.788187 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 16648
I20260809 02:19:33.788254 16783 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:33.788300 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:19:33.788412 16783 heartbeater.cc:511] Master 127.11.93.190:44567 requested a full tablet report, sending...
I20260809 02:19:33.788527 11638 external_mini_cluster.cc:1428] Setting key 49d2214af4363b41d63ae115d7f3e9c3
I20260809 02:19:33.788967 16582 ts_manager.cc:194] Registered new tserver with Master: 878e9c53d5a34fa5bb257db0e2eacb41 (127.11.93.129:33749)
I20260809 02:19:33.789749 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:44567
--builtin_ntp_servers=127.11.93.148:34479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 02:19:33.871404 16786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:33.871618 16786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:33.871639 16786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:33.872749 16786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:33.872789 16786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:33.872814 16786 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:19:33.874107 16786 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:34479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:44567
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16786
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:33.874298 16786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:33.874632 16786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:33.879882 16792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:33.879899 16791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:33.879899 16795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:33.880095 16786 server_base.cc:1034] running on GCE node
I20260809 02:19:33.880299 16786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:33.880573 16786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:33.881714 16786 hybrid_clock.cc:648] HybridClock initialized: now 1786241973881702 us; error 34 us; skew 500 ppm
I20260809 02:19:33.883088 16786 webserver.cc:460] Webserver started at http://127.11.93.130:39057/ using document root <none> and password file <none>
I20260809 02:19:33.883337 16786 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:33.883387 16786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:33.883558 16786 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:33.884696 16786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "fd80908f5ad84c89819d4b6c99e5c452"
format_stamp: "Formatted at 2026-08-09 02:19:33 on dist-test-slave-w206"
server_key: "f3e2ed3e4e00bbc83cbbf7c2ab7b8e6e"
server_key_iv: "e96602a923f3f6559125fe55fad98486"
server_key_version: "encryptionkey@0"
I20260809 02:19:33.885068 16786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "fd80908f5ad84c89819d4b6c99e5c452"
format_stamp: "Formatted at 2026-08-09 02:19:33 on dist-test-slave-w206"
server_key: "f3e2ed3e4e00bbc83cbbf7c2ab7b8e6e"
server_key_iv: "e96602a923f3f6559125fe55fad98486"
server_key_version: "encryptionkey@0"
I20260809 02:19:33.886359 16786 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:19:33.887137 16801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:33.887363 16786 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:33.887454 16786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "fd80908f5ad84c89819d4b6c99e5c452"
format_stamp: "Formatted at 2026-08-09 02:19:33 on dist-test-slave-w206"
server_key: "f3e2ed3e4e00bbc83cbbf7c2ab7b8e6e"
server_key_iv: "e96602a923f3f6559125fe55fad98486"
server_key_version: "encryptionkey@0"
I20260809 02:19:33.887507 16786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:33.890717 16786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:33.890928 16786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:33.891088 16786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:33.891263 16786 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:33.891518 16786 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:33.891548 16786 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:33.891568 16786 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:33.891582 16786 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:33.896960 16786 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:33399
I20260809 02:19:33.897035 16919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:33399 every 8 connection(s)
I20260809 02:19:33.897364 16786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:19:33.900547 16627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:33.898094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:58595 (local address 127.11.93.190:44567)
0809 02:19:33.898140 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:33.898142 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:33.898415 (+ 273us) server_negotiation.cc:407] Connection header received
0809 02:19:33.898944 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:33.898945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:33.898951 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:33.899057 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:33.900260 (+ 1203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:33.900262 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:33.900262 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:19:33.900268 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:33.900291 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:19:33.900296 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:33.900365 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:33.900460 (+ 95us) server_negotiation.cc:299] Negotiation successful
0809 02:19:33.900475 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 02:19:33.900750 16922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:33.898069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:44567 (local address 127.11.93.130:58595)
0809 02:19:33.898290 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:33.898323 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:33.898823 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:33.899136 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:33.899140 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:33.899147 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:33.900064 (+ 917us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:19:33.900065 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:33.900091 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:19:33.900118 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:33.900363 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:33.900370 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:33.900373 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:19:33.900470 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 02:19:33.900531 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":93,"threads_started":1}
I20260809 02:19:33.901227 16920 heartbeater.cc:347] Connected to a master server at 127.11.93.190:44567
I20260809 02:19:33.901300 16920 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:33.901470 16920 heartbeater.cc:511] Master 127.11.93.190:44567 requested a full tablet report, sending...
I20260809 02:19:33.901816 16581 ts_manager.cc:194] Registered new tserver with Master: fd80908f5ad84c89819d4b6c99e5c452 (127.11.93.130:33399)
I20260809 02:19:33.905023 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 16786
I20260809 02:19:33.905115 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:19:33.905277 11638 external_mini_cluster.cc:1428] Setting key d9c8c714642a91e21691dde88151a444
I20260809 02:19:33.906224 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:44567
--builtin_ntp_servers=127.11.93.148:34479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 02:19:33.987337 16923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:33.987528 16923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:33.987550 16923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:33.988636 16923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:33.988667 16923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:33.988692 16923 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:19:33.990059 16923 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:34479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:44567
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:33.990280 16923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:33.990530 16923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:33.995554 16931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:33.995585 16929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:33.995554 16928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:33.995894 16923 server_base.cc:1034] running on GCE node
I20260809 02:19:33.996110 16923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:33.996345 16923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:33.997524 16923 hybrid_clock.cc:648] HybridClock initialized: now 1786241973997512 us; error 29 us; skew 500 ppm
I20260809 02:19:33.998747 16923 webserver.cc:460] Webserver started at http://127.11.93.131:34019/ using document root <none> and password file <none>
I20260809 02:19:33.998963 16923 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:33.999074 16923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:33.999182 16923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:34.000227 16923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "187e08f98ea445c6844e6ba7163db0c2"
format_stamp: "Formatted at 2026-08-09 02:19:33 on dist-test-slave-w206"
server_key: "f1055b3148b0ae803f43b2482f62fb1d"
server_key_iv: "8c302e0748235d76d71e9072d2e47881"
server_key_version: "encryptionkey@0"
I20260809 02:19:34.000825 16923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "187e08f98ea445c6844e6ba7163db0c2"
format_stamp: "Formatted at 2026-08-09 02:19:33 on dist-test-slave-w206"
server_key: "f1055b3148b0ae803f43b2482f62fb1d"
server_key_iv: "8c302e0748235d76d71e9072d2e47881"
server_key_version: "encryptionkey@0"
I20260809 02:19:34.002151 16923 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:19:34.002887 16937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:34.003069 16923 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:34.003173 16923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "187e08f98ea445c6844e6ba7163db0c2"
format_stamp: "Formatted at 2026-08-09 02:19:33 on dist-test-slave-w206"
server_key: "f1055b3148b0ae803f43b2482f62fb1d"
server_key_iv: "8c302e0748235d76d71e9072d2e47881"
server_key_version: "encryptionkey@0"
I20260809 02:19:34.003296 16923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:34.006595 16923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:34.006876 16923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:34.007081 16923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:34.007321 16923 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:34.007639 16923 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:34.007694 16923 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:34.007740 16923 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:34.007768 16923 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:34.013494 16923 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:33141
I20260809 02:19:34.013568 17055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:33141 every 8 connection(s)
I20260809 02:19:34.013901 16923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:19:34.016925 16627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:34.014621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:40735 (local address 127.11.93.190:44567)
0809 02:19:34.014663 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:34.014666 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:34.014862 (+ 196us) server_negotiation.cc:407] Connection header received
0809 02:19:34.015455 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:34.015457 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:34.015464 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:34.015514 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:34.016623 (+ 1109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:34.016626 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:34.016626 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:19:34.016632 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:34.016647 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:19:34.016652 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:34.016746 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:34.016819 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 02:19:34.016852 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 02:19:34.017118 17058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:34.014573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:44567 (local address 127.11.93.131:40735)
0809 02:19:34.014740 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:34.014777 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:34.015325 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:34.015581 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:34.015585 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:34.015595 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:34.016454 (+ 859us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:19:34.016454 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:34.016481 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:19:34.016506 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:34.016746 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:34.016753 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:34.016756 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:19:34.016847 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 02:19:34.016909 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":67,"threads_started":1}
I20260809 02:19:34.017602 17056 heartbeater.cc:347] Connected to a master server at 127.11.93.190:44567
I20260809 02:19:34.017691 17056 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:34.017808 17056 heartbeater.cc:511] Master 127.11.93.190:44567 requested a full tablet report, sending...
I20260809 02:19:34.018126 16581 ts_manager.cc:194] Registered new tserver with Master: 187e08f98ea445c6844e6ba7163db0c2 (127.11.93.131:33141)
I20260809 02:19:34.021574 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 16923
I20260809 02:19:34.021661 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:19:34.021804 11638 external_mini_cluster.cc:1428] Setting key db2f711b629a84aa156998620548d137
I20260809 02:19:34.022706 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:19:34.025107 16627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:34.024049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59322 (local address 127.11.93.190:44567)
0809 02:19:34.024095 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:34.024097 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:34.024238 (+ 141us) server_negotiation.cc:407] Connection header received
0809 02:19:34.024271 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:34.024272 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:34.024276 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:34.024313 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:34.024911 (+ 598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:34.024912 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:34.024912 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:19:34.024914 (+ 2us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:34.024925 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:19:34.024928 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:34.024965 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:34.025002 (+ 37us) server_negotiation.cc:299] Negotiation successful
0809 02:19:34.025013 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 02:19:34.026788 16581 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59322:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:19:34.028352 16581 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:19:34.032130 17064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:34.030457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:33749 (local address 127.0.0.1:58284)
0809 02:19:34.030750 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:34.030791 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:34.030847 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:34.031124 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:34.031131 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:34.031138 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:34.031663 (+ 525us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:19:34.031663 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:34.031680 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:19:34.031703 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:34.031958 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:34.031965 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:34.031968 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:19:34.032031 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 02:19:34.032045 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"spinlock_wait_cycles":896,"thread_start_us":95,"threads_started":1}
I20260809 02:19:34.032368 17068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:34.030552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58284 (local address 127.11.93.129:33749)
0809 02:19:34.030942 (+ 390us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:34.030946 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:34.030955 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:19:34.031010 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:34.031012 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:34.031023 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:34.031106 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:34.031806 (+ 700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:34.031815 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:34.031816 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:19:34.031821 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:34.031857 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:19:34.031889 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:34.031948 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:34.032253 (+ 305us) server_negotiation.cc:299] Negotiation successful
0809 02:19:34.032272 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":93,"threads_started":1}
I20260809 02:19:34.032394 17067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:34.030535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45142 (local address 127.11.93.131:33141)
0809 02:19:34.030701 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:34.030705 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:34.030910 (+ 205us) server_negotiation.cc:407] Connection header received
0809 02:19:34.031032 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:34.031039 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:34.031050 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:34.031120 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:34.031955 (+ 835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:34.031961 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:34.031962 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:19:34.031966 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:34.031996 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:19:34.032015 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:34.032052 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:34.032190 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 02:19:34.032309 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":84,"threads_started":1}
I20260809 02:19:34.032881 17065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:34.030677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:33399 (local address 127.0.0.1:57860)
0809 02:19:34.031515 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:34.031527 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:34.031581 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:34.032013 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:34.032013 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:34.032016 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:34.032542 (+ 526us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:19:34.032542 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:34.032549 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:19:34.032563 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:34.032753 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:34.032754 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:34.032755 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 02:19:34.032801 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 02:19:34.032813 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":822,"thread_start_us":92,"threads_started":1}
I20260809 02:19:34.032904 17070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:34.030919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57860 (local address 127.11.93.130:33399)
0809 02:19:34.031150 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:34.031155 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:34.031888 (+ 733us) server_negotiation.cc:407] Connection header received
0809 02:19:34.031918 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:34.031921 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:34.031932 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:34.032011 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:34.032638 (+ 627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:34.032641 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:34.032641 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:19:34.032644 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:34.032667 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:19:34.032677 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:34.032728 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:34.032809 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 02:19:34.032824 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":102,"threads_started":1}
I20260809 02:19:34.032894 17069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:34.030463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:33141 (local address 127.0.0.1:45142)
0809 02:19:34.030818 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:34.030827 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:34.030936 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:34.031431 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:34.031432 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:34.031434 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:34.031840 (+ 406us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:19:34.031840 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:34.031848 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:19:34.031860 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:34.032102 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:34.032103 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:34.032104 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 02:19:34.032174 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 02:19:34.032390 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":70,"threads_started":1}
I20260809 02:19:34.033201 16714 tablet_service.cc:1467] Processing CreateTablet for tablet 313a4c9e1b33430b9cfe207b112fe29f (DEFAULT_TABLE table=test-table [id=2c827c1b644347b1b624b78dc8d5f2e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:34.033632 16714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 313a4c9e1b33430b9cfe207b112fe29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:34.033565 16852 tablet_service.cc:1467] Processing CreateTablet for tablet 313a4c9e1b33430b9cfe207b112fe29f (DEFAULT_TABLE table=test-table [id=2c827c1b644347b1b624b78dc8d5f2e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:34.033747 16989 tablet_service.cc:1467] Processing CreateTablet for tablet 313a4c9e1b33430b9cfe207b112fe29f (DEFAULT_TABLE table=test-table [id=2c827c1b644347b1b624b78dc8d5f2e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:34.033905 16852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 313a4c9e1b33430b9cfe207b112fe29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:34.034044 16989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 313a4c9e1b33430b9cfe207b112fe29f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:34.036615 17071 tablet_bootstrap.cc:492] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41: Bootstrap starting.
I20260809 02:19:34.037158 17072 tablet_bootstrap.cc:492] T 313a4c9e1b33430b9cfe207b112fe29f P fd80908f5ad84c89819d4b6c99e5c452: Bootstrap starting.
I20260809 02:19:34.037398 17071 tablet_bootstrap.cc:654] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:34.037737 17071 log.cc:824] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:34.037827 17072 tablet_bootstrap.cc:654] T 313a4c9e1b33430b9cfe207b112fe29f P fd80908f5ad84c89819d4b6c99e5c452: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:34.038125 17072 log.cc:824] T 313a4c9e1b33430b9cfe207b112fe29f P fd80908f5ad84c89819d4b6c99e5c452: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:34.038456 17073 tablet_bootstrap.cc:492] T 313a4c9e1b33430b9cfe207b112fe29f P 187e08f98ea445c6844e6ba7163db0c2: Bootstrap starting.
I20260809 02:19:34.038532 17071 tablet_bootstrap.cc:492] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41: No bootstrap required, opened a new log
I20260809 02:19:34.038584 17071 ts_tablet_manager.cc:1397] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:19:34.038884 17072 tablet_bootstrap.cc:492] T 313a4c9e1b33430b9cfe207b112fe29f P fd80908f5ad84c89819d4b6c99e5c452: No bootstrap required, opened a new log
I20260809 02:19:34.038965 17072 ts_tablet_manager.cc:1397] T 313a4c9e1b33430b9cfe207b112fe29f P fd80908f5ad84c89819d4b6c99e5c452: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:19:34.039145 17073 tablet_bootstrap.cc:654] T 313a4c9e1b33430b9cfe207b112fe29f P 187e08f98ea445c6844e6ba7163db0c2: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:34.039444 17073 log.cc:824] T 313a4c9e1b33430b9cfe207b112fe29f P 187e08f98ea445c6844e6ba7163db0c2: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:34.040249 17073 tablet_bootstrap.cc:492] T 313a4c9e1b33430b9cfe207b112fe29f P 187e08f98ea445c6844e6ba7163db0c2: No bootstrap required, opened a new log
I20260809 02:19:34.040318 17073 ts_tablet_manager.cc:1397] T 313a4c9e1b33430b9cfe207b112fe29f P 187e08f98ea445c6844e6ba7163db0c2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:19:34.041129 17072 raft_consensus.cc:348] T 313a4c9e1b33430b9cfe207b112fe29f P fd80908f5ad84c89819d4b6c99e5c452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "878e9c53d5a34fa5bb257db0e2eacb41" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 33749 } } peers { permanent_uuid: "187e08f98ea445c6844e6ba7163db0c2" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 33141 } } peers { permanent_uuid: "fd80908f5ad84c89819d4b6c99e5c452" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33399 } }
I20260809 02:19:34.041318 17072 raft_consensus.cc:374] T 313a4c9e1b33430b9cfe207b112fe29f P fd80908f5ad84c89819d4b6c99e5c452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:34.041364 17072 raft_consensus.cc:729] T 313a4c9e1b33430b9cfe207b112fe29f P fd80908f5ad84c89819d4b6c99e5c452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd80908f5ad84c89819d4b6c99e5c452, State: Initialized, Role: FOLLOWER
I20260809 02:19:34.041363 17071 raft_consensus.cc:348] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "878e9c53d5a34fa5bb257db0e2eacb41" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 33749 } } peers { permanent_uuid: "187e08f98ea445c6844e6ba7163db0c2" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 33141 } } peers { permanent_uuid: "fd80908f5ad84c89819d4b6c99e5c452" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33399 } }
I20260809 02:19:34.041548 17071 raft_consensus.cc:374] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:34.041507 17072 consensus_queue.cc:260] T 313a4c9e1b33430b9cfe207b112fe29f P fd80908f5ad84c89819d4b6c99e5c452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "878e9c53d5a34fa5bb257db0e2eacb41" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 33749 } } peers { permanent_uuid: "187e08f98ea445c6844e6ba7163db0c2" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 33141 } } peers { permanent_uuid: "fd80908f5ad84c89819d4b6c99e5c452" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33399 } }
I20260809 02:19:34.041581 17071 raft_consensus.cc:729] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 878e9c53d5a34fa5bb257db0e2eacb41, State: Initialized, Role: FOLLOWER
I20260809 02:19:34.041712 17071 consensus_queue.cc:260] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "878e9c53d5a34fa5bb257db0e2eacb41" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 33749 } } peers { permanent_uuid: "187e08f98ea445c6844e6ba7163db0c2" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 33141 } } peers { permanent_uuid: "fd80908f5ad84c89819d4b6c99e5c452" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33399 } }
I20260809 02:19:34.041759 17072 ts_tablet_manager.cc:1428] T 313a4c9e1b33430b9cfe207b112fe29f P fd80908f5ad84c89819d4b6c99e5c452: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 02:19:34.041886 16920 heartbeater.cc:503] Master 127.11.93.190:44567 was elected leader, sending a full tablet report...
I20260809 02:19:34.041956 17071 ts_tablet_manager.cc:1428] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 02:19:34.041985 16783 heartbeater.cc:503] Master 127.11.93.190:44567 was elected leader, sending a full tablet report...
I20260809 02:19:34.043057 17073 raft_consensus.cc:348] T 313a4c9e1b33430b9cfe207b112fe29f P 187e08f98ea445c6844e6ba7163db0c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "878e9c53d5a34fa5bb257db0e2eacb41" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 33749 } } peers { permanent_uuid: "187e08f98ea445c6844e6ba7163db0c2" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 33141 } } peers { permanent_uuid: "fd80908f5ad84c89819d4b6c99e5c452" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33399 } }
I20260809 02:19:34.043217 17073 raft_consensus.cc:374] T 313a4c9e1b33430b9cfe207b112fe29f P 187e08f98ea445c6844e6ba7163db0c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:34.043272 17073 raft_consensus.cc:729] T 313a4c9e1b33430b9cfe207b112fe29f P 187e08f98ea445c6844e6ba7163db0c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 187e08f98ea445c6844e6ba7163db0c2, State: Initialized, Role: FOLLOWER
I20260809 02:19:34.043385 17073 consensus_queue.cc:260] T 313a4c9e1b33430b9cfe207b112fe29f P 187e08f98ea445c6844e6ba7163db0c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "878e9c53d5a34fa5bb257db0e2eacb41" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 33749 } } peers { permanent_uuid: "187e08f98ea445c6844e6ba7163db0c2" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 33141 } } peers { permanent_uuid: "fd80908f5ad84c89819d4b6c99e5c452" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33399 } }
I20260809 02:19:34.043607 17073 ts_tablet_manager.cc:1428] T 313a4c9e1b33430b9cfe207b112fe29f P 187e08f98ea445c6844e6ba7163db0c2: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260809 02:19:34.043721 17056 heartbeater.cc:503] Master 127.11.93.190:44567 was elected leader, sending a full tablet report...
I20260809 02:19:34.120743 17078 raft_consensus.cc:482] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:19:34.120914 17078 raft_consensus.cc:504] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "878e9c53d5a34fa5bb257db0e2eacb41" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 33749 } } peers { permanent_uuid: "187e08f98ea445c6844e6ba7163db0c2" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 33141 } } peers { permanent_uuid: "fd80908f5ad84c89819d4b6c99e5c452" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33399 } }
I20260809 02:19:34.121325 17078 leader_election.cc:288] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 187e08f98ea445c6844e6ba7163db0c2 (127.11.93.131:33141), fd80908f5ad84c89819d4b6c99e5c452 (127.11.93.130:33399)
I20260809 02:19:34.122834 16785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:34.121530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:33141 (local address 127.11.93.129:57311)
0809 02:19:34.121589 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:34.121601 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:34.121643 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:34.121845 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:34.121846 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:34.121848 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:34.122384 (+ 536us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:19:34.122384 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:34.122393 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:19:34.122417 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:34.122687 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:34.122687 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:34.122688 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 02:19:34.122753 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 02:19:34.122770 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 02:19:34.122870 17067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:34.121602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:57311 (local address 127.11.93.131:33141)
0809 02:19:34.121658 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:34.121661 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:34.121671 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:19:34.121702 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:34.121703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:34.121709 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:34.121798 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:34.122503 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:34.122504 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:34.122504 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:19:34.122509 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:34.122528 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:19:34.122533 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:34.122594 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:34.122772 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 02:19:34.122804 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 02:19:34.123128 17070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:34.121724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:33481 (local address 127.11.93.130:33399)
0809 02:19:34.121801 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:34.121803 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:34.121924 (+ 121us) server_negotiation.cc:407] Connection header received
0809 02:19:34.121987 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:34.121988 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:34.121994 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:34.122064 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:34.122777 (+ 713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:34.122778 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:34.122778 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:19:34.122783 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:34.122798 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:19:34.122802 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:34.122835 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:34.123052 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 02:19:34.123069 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 02:19:34.123135 17080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:34.121615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:33399 (local address 127.11.93.129:33481)
0809 02:19:34.121834 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:34.121843 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:34.121930 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:34.122080 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:34.122081 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:34.122083 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:34.122647 (+ 564us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:19:34.122647 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:34.122672 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:19:34.122686 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:34.122929 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:34.122930 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:34.122931 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 02:19:34.123043 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 02:19:34.123058 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":128,"threads_started":1}
I20260809 02:19:34.123392 17010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "313a4c9e1b33430b9cfe207b112fe29f" candidate_uuid: "878e9c53d5a34fa5bb257db0e2eacb41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "187e08f98ea445c6844e6ba7163db0c2" is_pre_election: true
I20260809 02:19:34.123553 17010 raft_consensus.cc:2454] T 313a4c9e1b33430b9cfe207b112fe29f P 187e08f98ea445c6844e6ba7163db0c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 878e9c53d5a34fa5bb257db0e2eacb41 in term 0.
I20260809 02:19:34.123538 16872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "313a4c9e1b33430b9cfe207b112fe29f" candidate_uuid: "878e9c53d5a34fa5bb257db0e2eacb41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd80908f5ad84c89819d4b6c99e5c452" is_pre_election: true
I20260809 02:19:34.123718 16872 raft_consensus.cc:2454] T 313a4c9e1b33430b9cfe207b112fe29f P fd80908f5ad84c89819d4b6c99e5c452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 878e9c53d5a34fa5bb257db0e2eacb41 in term 0.
I20260809 02:19:34.123816 16665 leader_election.cc:302] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 187e08f98ea445c6844e6ba7163db0c2, 878e9c53d5a34fa5bb257db0e2eacb41; no voters:
I20260809 02:19:34.123947 17078 raft_consensus.cc:2781] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:19:34.124023 17078 raft_consensus.cc:482] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:19:34.124060 17078 raft_consensus.cc:3037] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:34.124868 17078 raft_consensus.cc:504] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "878e9c53d5a34fa5bb257db0e2eacb41" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 33749 } } peers { permanent_uuid: "187e08f98ea445c6844e6ba7163db0c2" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 33141 } } peers { permanent_uuid: "fd80908f5ad84c89819d4b6c99e5c452" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33399 } }
I20260809 02:19:34.125015 17078 leader_election.cc:288] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41 [CANDIDATE]: Term 1 election: Requested vote from peers 187e08f98ea445c6844e6ba7163db0c2 (127.11.93.131:33141), fd80908f5ad84c89819d4b6c99e5c452 (127.11.93.130:33399)
I20260809 02:19:34.125168 17010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "313a4c9e1b33430b9cfe207b112fe29f" candidate_uuid: "878e9c53d5a34fa5bb257db0e2eacb41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "187e08f98ea445c6844e6ba7163db0c2"
I20260809 02:19:34.125272 17010 raft_consensus.cc:3037] T 313a4c9e1b33430b9cfe207b112fe29f P 187e08f98ea445c6844e6ba7163db0c2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:34.126112 17010 raft_consensus.cc:2454] T 313a4c9e1b33430b9cfe207b112fe29f P 187e08f98ea445c6844e6ba7163db0c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 878e9c53d5a34fa5bb257db0e2eacb41 in term 1.
I20260809 02:19:34.126259 16872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "313a4c9e1b33430b9cfe207b112fe29f" candidate_uuid: "878e9c53d5a34fa5bb257db0e2eacb41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd80908f5ad84c89819d4b6c99e5c452"
I20260809 02:19:34.126291 16665 leader_election.cc:302] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 187e08f98ea445c6844e6ba7163db0c2, 878e9c53d5a34fa5bb257db0e2eacb41; no voters:
I20260809 02:19:34.126351 16872 raft_consensus.cc:3037] T 313a4c9e1b33430b9cfe207b112fe29f P fd80908f5ad84c89819d4b6c99e5c452 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:34.127058 17078 raft_consensus.cc:2781] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:34.127229 17078 raft_consensus.cc:686] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41 [term 1 LEADER]: Becoming Leader. State: Replica: 878e9c53d5a34fa5bb257db0e2eacb41, State: Running, Role: LEADER
I20260809 02:19:34.127302 16872 raft_consensus.cc:2454] T 313a4c9e1b33430b9cfe207b112fe29f P fd80908f5ad84c89819d4b6c99e5c452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 878e9c53d5a34fa5bb257db0e2eacb41 in term 1.
I20260809 02:19:34.127346 17078 consensus_queue.cc:237] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "878e9c53d5a34fa5bb257db0e2eacb41" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 33749 } } peers { permanent_uuid: "187e08f98ea445c6844e6ba7163db0c2" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 33141 } } peers { permanent_uuid: "fd80908f5ad84c89819d4b6c99e5c452" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33399 } }
I20260809 02:19:34.128230 16581 catalog_manager.cc:5495] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 878e9c53d5a34fa5bb257db0e2eacb41 (127.11.93.129). New cstate: current_term: 1 leader_uuid: "878e9c53d5a34fa5bb257db0e2eacb41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "878e9c53d5a34fa5bb257db0e2eacb41" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 33749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "187e08f98ea445c6844e6ba7163db0c2" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 33141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd80908f5ad84c89819d4b6c99e5c452" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33399 } health_report { overall_health: UNKNOWN } } }
W20260809 02:19:34.147941 16921 tablet.cc:2369] T 313a4c9e1b33430b9cfe207b112fe29f P fd80908f5ad84c89819d4b6c99e5c452: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:19:34.148927 17068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:34.147873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58296 (local address 127.11.93.129:33749)
0809 02:19:34.147925 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:34.147928 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:34.147938 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:19:34.148013 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:34.148015 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:34.148053 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:34.148108 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:34.148668 (+ 560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:34.148669 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:34.148669 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:19:34.148674 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:34.148690 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:19:34.148695 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:34.148778 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:34.148835 (+ 57us) server_negotiation.cc:299] Negotiation successful
0809 02:19:34.148850 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 02:19:34.150842 16872 raft_consensus.cc:1261] T 313a4c9e1b33430b9cfe207b112fe29f P fd80908f5ad84c89819d4b6c99e5c452 [term 1 FOLLOWER]: Refusing update from remote peer 878e9c53d5a34fa5bb257db0e2eacb41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:34.150863 17010 raft_consensus.cc:1261] T 313a4c9e1b33430b9cfe207b112fe29f P 187e08f98ea445c6844e6ba7163db0c2 [term 1 FOLLOWER]: Refusing update from remote peer 878e9c53d5a34fa5bb257db0e2eacb41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:34.151185 17081 consensus_queue.cc:1035] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd80908f5ad84c89819d4b6c99e5c452" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 33399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:34.151364 17078 consensus_queue.cc:1035] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "187e08f98ea445c6844e6ba7163db0c2" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 33141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:34.153867 17084 mvcc.cc:205] Tried to move back new op lower bound from 7316447126118760448 to 7316447126026280960. Current Snapshot: MvccSnapshot[applied={T|T < 7316447126118760448}]
I20260809 02:19:34.156574 16581 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59322:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:34.156682 16581 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59322:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:34.157450 16581 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8310febc03f84dd793a09a6b7a4b70f7: Sending DeleteTablet for 3 replicas of tablet 313a4c9e1b33430b9cfe207b112fe29f
I20260809 02:19:34.157794 16714 tablet_service.cc:1514] Processing DeleteTablet for tablet 313a4c9e1b33430b9cfe207b112fe29f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:34 UTC) from {username='slave'} at 127.0.0.1:58284
I20260809 02:19:34.157794 16852 tablet_service.cc:1514] Processing DeleteTablet for tablet 313a4c9e1b33430b9cfe207b112fe29f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:34 UTC) from {username='slave'} at 127.0.0.1:57860
I20260809 02:19:34.157815 16989 tablet_service.cc:1514] Processing DeleteTablet for tablet 313a4c9e1b33430b9cfe207b112fe29f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:34 UTC) from {username='slave'} at 127.0.0.1:45142
I20260809 02:19:34.158046 17095 tablet_replica.cc:330] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41: stopping tablet replica
I20260809 02:19:34.158147 17095 raft_consensus.cc:2229] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:19:34.158277 17095 raft_consensus.cc:2258] T 313a4c9e1b33430b9cfe207b112fe29f P 878e9c53d5a34fa5bb257db0e2eacb41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:34.158443 17094 tablet_replica.cc:330] T 313a4c9e1b33430b9cfe207b112fe29f P fd80908f5ad84c89819d4b6c99e5c452: stopping tablet replica
I20260809 02:19:34.158450 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 16648
I20260809 02:19:34.158535 17094 raft_consensus.cc:2229] T 313a4c9e1b33430b9cfe207b112fe29f P fd80908f5ad84c89819d4b6c99e5c452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:34.158619 17094 raft_consensus.cc:2258] T 313a4c9e1b33430b9cfe207b112fe29f P fd80908f5ad84c89819d4b6c99e5c452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:34.158764 17096 tablet_replica.cc:330] T 313a4c9e1b33430b9cfe207b112fe29f P 187e08f98ea445c6844e6ba7163db0c2: stopping tablet replica
I20260809 02:19:34.160137 17096 raft_consensus.cc:2229] T 313a4c9e1b33430b9cfe207b112fe29f P 187e08f98ea445c6844e6ba7163db0c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:34.160280 17096 raft_consensus.cc:2258] T 313a4c9e1b33430b9cfe207b112fe29f P 187e08f98ea445c6844e6ba7163db0c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:34.160790 17094 ts_tablet_manager.cc:1905] T 313a4c9e1b33430b9cfe207b112fe29f P fd80908f5ad84c89819d4b6c99e5c452: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:34.160877 17096 ts_tablet_manager.cc:1905] T 313a4c9e1b33430b9cfe207b112fe29f P 187e08f98ea445c6844e6ba7163db0c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:34.162369 17094 ts_tablet_manager.cc:1918] T 313a4c9e1b33430b9cfe207b112fe29f P fd80908f5ad84c89819d4b6c99e5c452: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:19:34.162463 17094 log.cc:1196] T 313a4c9e1b33430b9cfe207b112fe29f P fd80908f5ad84c89819d4b6c99e5c452: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/313a4c9e1b33430b9cfe207b112fe29f
I20260809 02:19:34.162736 17094 ts_tablet_manager.cc:1939] T 313a4c9e1b33430b9cfe207b112fe29f P fd80908f5ad84c89819d4b6c99e5c452: Deleting consensus metadata
I20260809 02:19:34.162842 17096 ts_tablet_manager.cc:1918] T 313a4c9e1b33430b9cfe207b112fe29f P 187e08f98ea445c6844e6ba7163db0c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:19:34.162927 17096 log.cc:1196] T 313a4c9e1b33430b9cfe207b112fe29f P 187e08f98ea445c6844e6ba7163db0c2: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/313a4c9e1b33430b9cfe207b112fe29f
I20260809 02:19:34.163208 17096 ts_tablet_manager.cc:1939] T 313a4c9e1b33430b9cfe207b112fe29f P 187e08f98ea445c6844e6ba7163db0c2: Deleting consensus metadata
I20260809 02:19:34.163233 16569 catalog_manager.cc:4841] TS fd80908f5ad84c89819d4b6c99e5c452 (127.11.93.130:33399): tablet 313a4c9e1b33430b9cfe207b112fe29f (table test-table [id=2c827c1b644347b1b624b78dc8d5f2e2]) successfully deleted
I20260809 02:19:34.163653 16567 catalog_manager.cc:4841] TS 187e08f98ea445c6844e6ba7163db0c2 (127.11.93.131:33141): tablet 313a4c9e1b33430b9cfe207b112fe29f (table test-table [id=2c827c1b644347b1b624b78dc8d5f2e2]) successfully deleted
W20260809 02:19:34.166676 16569 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.93.129:33749 (error 108)
I20260809 02:19:34.166817 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 16786
I20260809 02:19:34.168233 17069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:34.168074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:33749 (local address 127.0.0.1:58298)
0809 02:19:34.168140 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:34.168184 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.129:33749: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 02:19:34.168392 16569 catalog_manager.cc:4584] TS 878e9c53d5a34fa5bb257db0e2eacb41 (127.11.93.129:33749): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 313a4c9e1b33430b9cfe207b112fe29f: Network error: Client connection negotiation failed: client connection to 127.11.93.129:33749: connect: Connection refused (error 111)
I20260809 02:19:34.175276 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 16923
I20260809 02:19:34.181800 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 16551
2026-08-09T02:19:34Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (676 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260809 02:19:34.203270 11638 mini_oidc.cc:152] Starting JWKS server
I20260809 02:19:34.204509 11638 webserver.cc:460] Webserver started at https://127.0.0.1:39089/ using document root <none> and password file <none>
I20260809 02:19:34.204636 11638 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 02:19:34.204826 11638 webserver.cc:460] Webserver started at http://127.0.0.1:33071/ using document root <none> and password file <none>
2026-08-09T02:19:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:19:34Z Disabled control of system clock
I20260809 02:19:34.213896 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:42609
--webserver_interface=127.11.93.190
--webserver_port=0
--builtin_ntp_servers=127.11.93.148:34015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:42609
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39089/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786241951749734-11638-0/testchainca.cert with env {}
W20260809 02:19:34.296597 17103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:34.296799 17103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:34.296821 17103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:34.297998 17103 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:19:34.298039 17103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:34.298051 17103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:34.298064 17103 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:19:34.298076 17103 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 02:19:34.298089 17103 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 02:19:34.298100 17103 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39089/jwks.json
I20260809 02:19:34.299664 17103 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:34015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:42609
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:42609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39089/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786241951749734-11638-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:34.299857 17103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:34.300051 17103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:34.305012 17109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:34.305055 17112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:34.305184 17103 server_base.cc:1034] running on GCE node
W20260809 02:19:34.305058 17110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:34.305583 17103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:34.305868 17103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:34.307035 17103 hybrid_clock.cc:648] HybridClock initialized: now 1786241974307024 us; error 27 us; skew 500 ppm
I20260809 02:19:34.308336 17103 webserver.cc:460] Webserver started at http://127.11.93.190:46803/ using document root <none> and password file <none>
I20260809 02:19:34.308604 17103 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:34.308676 17103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:34.308820 17103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:34.309829 17103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "8b06b28d403f4eca81593e306d22e7fd"
format_stamp: "Formatted at 2026-08-09 02:19:34 on dist-test-slave-w206"
server_key: "8747a381709a94e81afecb6acfc17695"
server_key_iv: "76e9ca7e48bb3922f8758d0e20ef06c6"
server_key_version: "encryptionkey@0"
I20260809 02:19:34.310189 17103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "8b06b28d403f4eca81593e306d22e7fd"
format_stamp: "Formatted at 2026-08-09 02:19:34 on dist-test-slave-w206"
server_key: "8747a381709a94e81afecb6acfc17695"
server_key_iv: "76e9ca7e48bb3922f8758d0e20ef06c6"
server_key_version: "encryptionkey@0"
I20260809 02:19:34.311585 17103 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:19:34.312304 17118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:34.312492 17103 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:19:34.312593 17103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "8b06b28d403f4eca81593e306d22e7fd"
format_stamp: "Formatted at 2026-08-09 02:19:34 on dist-test-slave-w206"
server_key: "8747a381709a94e81afecb6acfc17695"
server_key_iv: "76e9ca7e48bb3922f8758d0e20ef06c6"
server_key_version: "encryptionkey@0"
I20260809 02:19:34.312673 17103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:34.320899 17103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:34.321201 17103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:34.321349 17103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:34.325330 17103 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:42609
I20260809 02:19:34.325361 17172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:42609 every 8 connection(s)
I20260809 02:19:34.325692 17103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:19:34.326665 17173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:34.328454 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 17103
I20260809 02:19:34.328579 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:19:34.328779 11638 external_mini_cluster.cc:1428] Setting key ad6d89ab5ab0bec230d4e140e5eb5cbf
I20260809 02:19:34.329404 17173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b06b28d403f4eca81593e306d22e7fd: Bootstrap starting.
I20260809 02:19:34.330024 17173 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b06b28d403f4eca81593e306d22e7fd: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:34.330333 17173 log.cc:824] T 00000000000000000000000000000000 P 8b06b28d403f4eca81593e306d22e7fd: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:34.331101 17173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b06b28d403f4eca81593e306d22e7fd: No bootstrap required, opened a new log
I20260809 02:19:34.333407 17173 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b06b28d403f4eca81593e306d22e7fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b06b28d403f4eca81593e306d22e7fd" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42609 } }
I20260809 02:19:34.333571 17173 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b06b28d403f4eca81593e306d22e7fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:34.333598 17173 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b06b28d403f4eca81593e306d22e7fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b06b28d403f4eca81593e306d22e7fd, State: Initialized, Role: FOLLOWER
I20260809 02:19:34.333739 17173 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b06b28d403f4eca81593e306d22e7fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b06b28d403f4eca81593e306d22e7fd" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42609 } }
I20260809 02:19:34.333832 17173 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b06b28d403f4eca81593e306d22e7fd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:19:34.333873 17173 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b06b28d403f4eca81593e306d22e7fd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:19:34.333930 17173 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b06b28d403f4eca81593e306d22e7fd [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:34.334657 17173 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b06b28d403f4eca81593e306d22e7fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b06b28d403f4eca81593e306d22e7fd" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42609 } }
I20260809 02:19:34.334697 17176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:34.329280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37160 (local address 127.11.93.190:42609)
0809 02:19:34.329505 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:34.329514 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:34.329550 (+ 36us) server_negotiation.cc:407] Connection header received
0809 02:19:34.329956 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:34.329962 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:34.330018 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:34.330175 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:34.330505 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:34.331600 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:34.332714 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:34.333093 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:34.333185 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:34.333950 (+ 765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:34.333954 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:34.333955 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:19:34.334162 (+ 207us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:34.334203 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:19:34.334217 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:34.334286 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:34.334382 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 02:19:34.334464 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":87,"threads_started":1}
I20260809 02:19:34.334767 17173 leader_election.cc:302] T 00000000000000000000000000000000 P 8b06b28d403f4eca81593e306d22e7fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b06b28d403f4eca81593e306d22e7fd; no voters:
I20260809 02:19:34.334916 17173 leader_election.cc:288] T 00000000000000000000000000000000 P 8b06b28d403f4eca81593e306d22e7fd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:19:34.335078 17178 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b06b28d403f4eca81593e306d22e7fd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:34.335207 17173 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b06b28d403f4eca81593e306d22e7fd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:19:34.335295 17178 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b06b28d403f4eca81593e306d22e7fd [term 1 LEADER]: Becoming Leader. State: Replica: 8b06b28d403f4eca81593e306d22e7fd, State: Running, Role: LEADER
I20260809 02:19:34.335404 17178 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b06b28d403f4eca81593e306d22e7fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b06b28d403f4eca81593e306d22e7fd" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42609 } }
I20260809 02:19:34.335659 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:19:34.335739 17178 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b06b28d403f4eca81593e306d22e7fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b06b28d403f4eca81593e306d22e7fd. Latest consensus state: current_term: 1 leader_uuid: "8b06b28d403f4eca81593e306d22e7fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b06b28d403f4eca81593e306d22e7fd" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42609 } } }
I20260809 02:19:34.335807 17178 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b06b28d403f4eca81593e306d22e7fd [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:34.335829 17179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b06b28d403f4eca81593e306d22e7fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b06b28d403f4eca81593e306d22e7fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b06b28d403f4eca81593e306d22e7fd" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42609 } } }
I20260809 02:19:34.335953 17179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b06b28d403f4eca81593e306d22e7fd [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:34.336004 17187 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:19:34.336509 17187 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:19:34.338032 17187 catalog_manager.cc:1347] Generated new cluster ID: 37703a96ae5b402085e7e35860a4814a
I20260809 02:19:34.338086 17187 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:19:34.360924 17187 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:19:34.361455 17187 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:19:34.376446 17187 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b06b28d403f4eca81593e306d22e7fd: Generated new TSK 0
I20260809 02:19:34.376667 17187 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 02:19:34.406608 17203 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260809 02:19:34.406759 17203 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 02:19:34.407058 17176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:34.391438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37170 (local address 127.11.93.190:42609)
0809 02:19:34.391496 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:34.391498 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:34.391626 (+ 128us) server_negotiation.cc:407] Connection header received
0809 02:19:34.391711 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:34.391712 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:34.391727 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:34.391796 (+ 69us) server_negotiation.cc:226] Negotiated authn=JWT
0809 02:19:34.391936 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:34.392692 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:34.393422 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:34.393715 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:34.393792 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:34.393965 (+ 173us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 02:19:34.406794 (+ 12829us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39089/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 02:19:34.406959 (+ 165us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37170: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39089/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":34}
W20260809 02:19:34.407140 17176 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37170: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39089/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260809 02:19:34.407507 17202 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:34.391344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42609 (local address 127.0.0.1:37170)
0809 02:19:34.391558 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:34.391568 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:34.391628 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:34.391809 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:34.391809 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:34.391811 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0809 02:19:34.391870 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:34.391872 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:34.392770 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:34.392771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:34.393336 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:34.393337 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:34.393798 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:34.393799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:34.393843 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:34.393861 (+ 18us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 02:19:34.406949 (+ 13088us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39089/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 02:19:34.407098 (+ 149us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.93.190:42609: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39089/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":108,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.11.93.190:42609: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39089/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260809 02:19:34.408191 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 17103
2026-08-09T02:19:34Z chronyd exiting
I20260809 02:19:34.446689 11638 test_util.cc:175] -----------------------------------------------
I20260809 02:19:34.446765 11638 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786241951749734-11638-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (244 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260809 02:19:34.447607 11638 mini_oidc.cc:152] Starting JWKS server
I20260809 02:19:34.448262 11638 webserver.cc:460] Webserver started at https://127.0.0.1:40273/ using document root <none> and password file <none>
I20260809 02:19:34.448303 11638 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 02:19:34.448567 11638 webserver.cc:460] Webserver started at http://127.0.0.1:39577/ using document root <none> and password file <none>
2026-08-09T02:19:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:19:34Z Disabled control of system clock
I20260809 02:19:34.458222 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:45911
--webserver_interface=127.11.93.190
--webserver_port=0
--builtin_ntp_servers=127.11.93.148:46371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:45911
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40273/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786241951749734-11638-0/testchainca.cert with env {}
W20260809 02:19:34.541114 17210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:34.541325 17210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:34.541350 17210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:34.542577 17210 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:19:34.542624 17210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:34.542639 17210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:34.542660 17210 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:19:34.542681 17210 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 02:19:34.542744 17210 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 02:19:34.542764 17210 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40273/jwks.json
I20260809 02:19:34.544327 17210 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:46371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:45911
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:45911
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40273/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786241951749734-11638-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:34.544597 17210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:34.544834 17210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:34.549942 17216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:34.549981 17215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:34.550163 17210 server_base.cc:1034] running on GCE node
W20260809 02:19:34.549949 17218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:34.550482 17210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:34.550721 17210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:34.551858 17210 hybrid_clock.cc:648] HybridClock initialized: now 1786241974551852 us; error 49 us; skew 500 ppm
I20260809 02:19:34.553105 17210 webserver.cc:460] Webserver started at http://127.11.93.190:38645/ using document root <none> and password file <none>
I20260809 02:19:34.553357 17210 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:34.553414 17210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:34.553577 17210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:34.554589 17210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "01f28b592a184fc781217fa2461a9d4c"
format_stamp: "Formatted at 2026-08-09 02:19:34 on dist-test-slave-w206"
server_key: "b189abbf8059af035c98b52f975ec13d"
server_key_iv: "a65a9e3791bdc162409dd2adf441014b"
server_key_version: "encryptionkey@0"
I20260809 02:19:34.554941 17210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "01f28b592a184fc781217fa2461a9d4c"
format_stamp: "Formatted at 2026-08-09 02:19:34 on dist-test-slave-w206"
server_key: "b189abbf8059af035c98b52f975ec13d"
server_key_iv: "a65a9e3791bdc162409dd2adf441014b"
server_key_version: "encryptionkey@0"
I20260809 02:19:34.556229 17210 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:19:34.556988 17224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:34.557163 17210 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:34.557227 17210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "01f28b592a184fc781217fa2461a9d4c"
format_stamp: "Formatted at 2026-08-09 02:19:34 on dist-test-slave-w206"
server_key: "b189abbf8059af035c98b52f975ec13d"
server_key_iv: "a65a9e3791bdc162409dd2adf441014b"
server_key_version: "encryptionkey@0"
I20260809 02:19:34.557298 17210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:34.573755 17210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:34.574056 17210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:34.574204 17210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:34.578301 17210 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:45911
I20260809 02:19:34.578368 17277 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:45911 every 8 connection(s)
I20260809 02:19:34.578701 17210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:19:34.579485 17278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:34.582603 17278 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01f28b592a184fc781217fa2461a9d4c: Bootstrap starting.
I20260809 02:19:34.582785 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 17210
I20260809 02:19:34.582923 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:19:34.583169 11638 external_mini_cluster.cc:1428] Setting key 9ba38195aa73852976b29f05bd74eb17
I20260809 02:19:34.583425 17278 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 01f28b592a184fc781217fa2461a9d4c: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:34.583797 17278 log.cc:824] T 00000000000000000000000000000000 P 01f28b592a184fc781217fa2461a9d4c: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:34.584693 17278 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01f28b592a184fc781217fa2461a9d4c: No bootstrap required, opened a new log
I20260809 02:19:34.587304 17278 raft_consensus.cc:348] T 00000000000000000000000000000000 P 01f28b592a184fc781217fa2461a9d4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01f28b592a184fc781217fa2461a9d4c" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45911 } }
I20260809 02:19:34.587442 17278 raft_consensus.cc:374] T 00000000000000000000000000000000 P 01f28b592a184fc781217fa2461a9d4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:34.587473 17278 raft_consensus.cc:729] T 00000000000000000000000000000000 P 01f28b592a184fc781217fa2461a9d4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01f28b592a184fc781217fa2461a9d4c, State: Initialized, Role: FOLLOWER
I20260809 02:19:34.587657 17278 consensus_queue.cc:260] T 00000000000000000000000000000000 P 01f28b592a184fc781217fa2461a9d4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01f28b592a184fc781217fa2461a9d4c" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45911 } }
I20260809 02:19:34.587746 17278 raft_consensus.cc:388] T 00000000000000000000000000000000 P 01f28b592a184fc781217fa2461a9d4c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:19:34.587776 17278 raft_consensus.cc:482] T 00000000000000000000000000000000 P 01f28b592a184fc781217fa2461a9d4c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:19:34.587822 17278 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 01f28b592a184fc781217fa2461a9d4c [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:34.588570 17278 raft_consensus.cc:504] T 00000000000000000000000000000000 P 01f28b592a184fc781217fa2461a9d4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01f28b592a184fc781217fa2461a9d4c" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45911 } }
I20260809 02:19:34.588689 17278 leader_election.cc:302] T 00000000000000000000000000000000 P 01f28b592a184fc781217fa2461a9d4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 01f28b592a184fc781217fa2461a9d4c; no voters:
I20260809 02:19:34.588856 17278 leader_election.cc:288] T 00000000000000000000000000000000 P 01f28b592a184fc781217fa2461a9d4c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:19:34.589038 17285 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 01f28b592a184fc781217fa2461a9d4c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:34.589157 17278 sys_catalog.cc:564] T 00000000000000000000000000000000 P 01f28b592a184fc781217fa2461a9d4c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:19:34.589265 17285 raft_consensus.cc:686] T 00000000000000000000000000000000 P 01f28b592a184fc781217fa2461a9d4c [term 1 LEADER]: Becoming Leader. State: Replica: 01f28b592a184fc781217fa2461a9d4c, State: Running, Role: LEADER
I20260809 02:19:34.589435 17285 consensus_queue.cc:237] T 00000000000000000000000000000000 P 01f28b592a184fc781217fa2461a9d4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01f28b592a184fc781217fa2461a9d4c" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45911 } }
I20260809 02:19:34.589963 17283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01f28b592a184fc781217fa2461a9d4c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "01f28b592a184fc781217fa2461a9d4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01f28b592a184fc781217fa2461a9d4c" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45911 } } }
I20260809 02:19:34.590010 17281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:34.583717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34808 (local address 127.11.93.190:45911)
0809 02:19:34.583955 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:34.583966 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:34.584005 (+ 39us) server_negotiation.cc:407] Connection header received
0809 02:19:34.584605 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:34.584613 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:34.584704 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:34.584919 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:34.585108 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:34.586659 (+ 1551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:34.587607 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:34.588290 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:34.588432 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:34.589239 (+ 807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:34.589244 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:34.589244 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:19:34.589450 (+ 206us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:34.589491 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:19:34.589505 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:34.589569 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:34.589705 (+ 136us) server_negotiation.cc:299] Negotiation successful
0809 02:19:34.589786 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":98,"threads_started":1}
I20260809 02:19:34.589975 17287 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01f28b592a184fc781217fa2461a9d4c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 01f28b592a184fc781217fa2461a9d4c. Latest consensus state: current_term: 1 leader_uuid: "01f28b592a184fc781217fa2461a9d4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01f28b592a184fc781217fa2461a9d4c" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45911 } } }
I20260809 02:19:34.590093 17283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01f28b592a184fc781217fa2461a9d4c [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:34.590113 17287 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01f28b592a184fc781217fa2461a9d4c [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:34.590287 17294 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:19:34.590796 17294 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:19:34.591192 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:19:34.592542 17294 catalog_manager.cc:1347] Generated new cluster ID: e06e35d6447442faa8a8fccbeabb5197
I20260809 02:19:34.592602 17294 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:19:34.607417 17294 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:19:34.608224 17294 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:19:34.614909 17294 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 01f28b592a184fc781217fa2461a9d4c: Generated new TSK 0
I20260809 02:19:34.615121 17294 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 02:19:34.637025 17310 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260809 02:19:34.637110 17310 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 02:19:34.637425 17281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:34.623260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34814 (local address 127.11.93.190:45911)
0809 02:19:34.623304 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:34.623306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:34.623381 (+ 75us) server_negotiation.cc:407] Connection header received
0809 02:19:34.623469 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:34.623470 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:34.623480 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:34.623540 (+ 60us) server_negotiation.cc:226] Negotiated authn=JWT
0809 02:19:34.623676 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:34.624168 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:34.625305 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:34.625491 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:34.625535 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:34.625721 (+ 186us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 02:19:34.637243 (+ 11522us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40273/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 02:19:34.637357 (+ 114us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34814: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40273/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":20}
W20260809 02:19:34.637496 17281 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34814: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40273/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260809 02:19:34.637567 17309 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:34.623148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45911 (local address 127.0.0.1:34814)
0809 02:19:34.623321 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:34.623333 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:34.623400 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:34.623554 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:34.623555 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:34.623557 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0809 02:19:34.623613 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:34.623615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:34.624236 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:34.624237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:34.625218 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:34.625221 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:34.625557 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:34.625558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:34.625620 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:34.625626 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 02:19:34.637350 (+ 11724us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40273/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 02:19:34.637470 (+ 120us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.93.190:45911: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40273/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":103,"threads_started":1}
I20260809 02:19:34.637847 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 17210
2026-08-09T02:19:34Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (229 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260809 02:19:34.677343 11638 mini_oidc.cc:152] Starting JWKS server
I20260809 02:19:34.678052 11638 webserver.cc:460] Webserver started at https://127.0.0.1:40041/ using document root <none> and password file <none>
I20260809 02:19:34.678123 11638 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 02:19:34.678306 11638 webserver.cc:460] Webserver started at http://127.0.0.1:34371/ using document root <none> and password file <none>
2026-08-09T02:19:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:19:34Z Disabled control of system clock
I20260809 02:19:34.687326 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:40613
--webserver_interface=127.11.93.190
--webserver_port=0
--builtin_ntp_servers=127.11.93.148:46189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:40613
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40041/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 02:19:34.770162 17316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:34.770385 17316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:34.770406 17316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:34.771689 17316 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:19:34.771732 17316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:34.771745 17316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:34.771759 17316 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:19:34.771802 17316 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 02:19:34.771821 17316 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 02:19:34.771847 17316 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40041/jwks.json
I20260809 02:19:34.773265 17316 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:46189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:40613
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:40613
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40041/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:34.773517 17316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:34.773809 17316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:34.778889 17322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:34.778920 17316 server_base.cc:1034] running on GCE node
W20260809 02:19:34.778891 17324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:34.778921 17321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:34.779379 17316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:34.779670 17316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:34.780833 17316 hybrid_clock.cc:648] HybridClock initialized: now 1786241974780815 us; error 40 us; skew 500 ppm
I20260809 02:19:34.782074 17316 webserver.cc:460] Webserver started at http://127.11.93.190:45319/ using document root <none> and password file <none>
I20260809 02:19:34.782316 17316 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:34.782392 17316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:34.782536 17316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:34.783661 17316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "b345ff2eff4345a893e9d18307531aaa"
format_stamp: "Formatted at 2026-08-09 02:19:34 on dist-test-slave-w206"
server_key: "bce9bcf324e873fb79ff22dbeb29be1b"
server_key_iv: "2e84fa3d5df9625cea6a021a8d5d3726"
server_key_version: "encryptionkey@0"
I20260809 02:19:34.784040 17316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "b345ff2eff4345a893e9d18307531aaa"
format_stamp: "Formatted at 2026-08-09 02:19:34 on dist-test-slave-w206"
server_key: "bce9bcf324e873fb79ff22dbeb29be1b"
server_key_iv: "2e84fa3d5df9625cea6a021a8d5d3726"
server_key_version: "encryptionkey@0"
I20260809 02:19:34.785390 17316 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 02:19:34.786142 17331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:34.786346 17316 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:19:34.786459 17316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "b345ff2eff4345a893e9d18307531aaa"
format_stamp: "Formatted at 2026-08-09 02:19:34 on dist-test-slave-w206"
server_key: "bce9bcf324e873fb79ff22dbeb29be1b"
server_key_iv: "2e84fa3d5df9625cea6a021a8d5d3726"
server_key_version: "encryptionkey@0"
I20260809 02:19:34.786535 17316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:34.802713 17316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:34.803164 17316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:34.803335 17316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:34.807533 17316 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:40613
I20260809 02:19:34.807583 17386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:40613 every 8 connection(s)
I20260809 02:19:34.807945 17316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:19:34.808636 17387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:34.811452 17387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b345ff2eff4345a893e9d18307531aaa: Bootstrap starting.
I20260809 02:19:34.812047 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 17316
I20260809 02:19:34.812067 17387 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b345ff2eff4345a893e9d18307531aaa: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:34.812186 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:19:34.812399 11638 external_mini_cluster.cc:1428] Setting key 96c396d90ec259d153d508f1c1039431
I20260809 02:19:34.812392 17387 log.cc:824] T 00000000000000000000000000000000 P b345ff2eff4345a893e9d18307531aaa: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:34.813212 17387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b345ff2eff4345a893e9d18307531aaa: No bootstrap required, opened a new log
I20260809 02:19:34.815892 17387 raft_consensus.cc:348] T 00000000000000000000000000000000 P b345ff2eff4345a893e9d18307531aaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b345ff2eff4345a893e9d18307531aaa" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40613 } }
I20260809 02:19:34.816022 17387 raft_consensus.cc:374] T 00000000000000000000000000000000 P b345ff2eff4345a893e9d18307531aaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:34.816044 17387 raft_consensus.cc:729] T 00000000000000000000000000000000 P b345ff2eff4345a893e9d18307531aaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b345ff2eff4345a893e9d18307531aaa, State: Initialized, Role: FOLLOWER
I20260809 02:19:34.816172 17387 consensus_queue.cc:260] T 00000000000000000000000000000000 P b345ff2eff4345a893e9d18307531aaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b345ff2eff4345a893e9d18307531aaa" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40613 } }
I20260809 02:19:34.816244 17387 raft_consensus.cc:388] T 00000000000000000000000000000000 P b345ff2eff4345a893e9d18307531aaa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:19:34.816267 17387 raft_consensus.cc:482] T 00000000000000000000000000000000 P b345ff2eff4345a893e9d18307531aaa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:19:34.816339 17387 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b345ff2eff4345a893e9d18307531aaa [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:34.817008 17387 raft_consensus.cc:504] T 00000000000000000000000000000000 P b345ff2eff4345a893e9d18307531aaa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b345ff2eff4345a893e9d18307531aaa" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40613 } }
I20260809 02:19:34.817113 17387 leader_election.cc:302] T 00000000000000000000000000000000 P b345ff2eff4345a893e9d18307531aaa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b345ff2eff4345a893e9d18307531aaa; no voters:
I20260809 02:19:34.817269 17387 leader_election.cc:288] T 00000000000000000000000000000000 P b345ff2eff4345a893e9d18307531aaa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:19:34.817332 17392 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b345ff2eff4345a893e9d18307531aaa [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:34.817531 17387 sys_catalog.cc:564] T 00000000000000000000000000000000 P b345ff2eff4345a893e9d18307531aaa [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:19:34.817541 17392 raft_consensus.cc:686] T 00000000000000000000000000000000 P b345ff2eff4345a893e9d18307531aaa [term 1 LEADER]: Becoming Leader. State: Replica: b345ff2eff4345a893e9d18307531aaa, State: Running, Role: LEADER
I20260809 02:19:34.817706 17392 consensus_queue.cc:237] T 00000000000000000000000000000000 P b345ff2eff4345a893e9d18307531aaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b345ff2eff4345a893e9d18307531aaa" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40613 } }
I20260809 02:19:34.818065 17392 sys_catalog.cc:455] T 00000000000000000000000000000000 P b345ff2eff4345a893e9d18307531aaa [sys.catalog]: SysCatalogTable state changed. Reason: New leader b345ff2eff4345a893e9d18307531aaa. Latest consensus state: current_term: 1 leader_uuid: "b345ff2eff4345a893e9d18307531aaa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b345ff2eff4345a893e9d18307531aaa" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40613 } } }
I20260809 02:19:34.818156 17392 sys_catalog.cc:458] T 00000000000000000000000000000000 P b345ff2eff4345a893e9d18307531aaa [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:34.818079 17394 sys_catalog.cc:455] T 00000000000000000000000000000000 P b345ff2eff4345a893e9d18307531aaa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b345ff2eff4345a893e9d18307531aaa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b345ff2eff4345a893e9d18307531aaa" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40613 } } }
I20260809 02:19:34.818324 17394 sys_catalog.cc:458] T 00000000000000000000000000000000 P b345ff2eff4345a893e9d18307531aaa [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:34.818485 17401 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:19:34.819010 17401 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:19:34.819249 17391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:34.812958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44864 (local address 127.11.93.190:40613)
0809 02:19:34.813178 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:34.813188 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:34.813225 (+ 37us) server_negotiation.cc:407] Connection header received
0809 02:19:34.813744 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:34.813754 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:34.813838 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:34.813986 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:34.814194 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:34.815652 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:34.816614 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:34.817258 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:34.817391 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:34.818378 (+ 987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:34.818382 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:34.818383 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:19:34.818596 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:34.818639 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:19:34.818653 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:34.818697 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:34.818895 (+ 198us) server_negotiation.cc:299] Negotiation successful
0809 02:19:34.819002 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":90,"threads_started":1}
I20260809 02:19:34.820415 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:19:34.820716 17401 catalog_manager.cc:1347] Generated new cluster ID: d94cec90a55148258df1f2e6267353de
I20260809 02:19:34.820768 17401 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:19:34.830935 17401 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:19:34.831451 17401 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:19:34.838200 17401 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b345ff2eff4345a893e9d18307531aaa: Generated new TSK 0
I20260809 02:19:34.838385 17401 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:19:34.852047 17391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:34.848232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44866 (local address 127.11.93.190:40613)
0809 02:19:34.848275 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:34.848277 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:34.848425 (+ 148us) server_negotiation.cc:407] Connection header received
0809 02:19:34.848511 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:34.848512 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:34.848522 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:34.848582 (+ 60us) server_negotiation.cc:226] Negotiated authn=JWT
0809 02:19:34.848725 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:34.849203 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:34.850368 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:34.850553 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:34.850604 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:34.850812 (+ 208us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 02:19:34.851784 (+ 972us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40041/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 02:19:34.851941 (+ 157us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44866: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40041/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":22}
W20260809 02:19:34.852109 17418 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:34.848172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40613 (local address 127.0.0.1:44866)
0809 02:19:34.848340 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:34.848370 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:34.848443 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:34.848601 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:34.848602 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:34.848604 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0809 02:19:34.848661 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:34.848663 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:34.849314 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:34.849315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:34.850282 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:34.850285 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:34.850637 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:34.850638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:34.850701 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:34.850719 (+ 18us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 02:19:34.851906 (+ 1187us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40041/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 02:19:34.851997 (+ 91us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.93.190:40613: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40041/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":82,"threads_started":1}
W20260809 02:19:34.852120 17391 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44866: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40041/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
I20260809 02:19:34.852528 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 17316
E20260809 02:19:34.863220 17419 webserver.cc:533] Webserver: sslize failed:
E20260809 02:19:34.863288 17419 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-09T02:19:34Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (214 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-09T02:19:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:19:34Z Disabled control of system clock
I20260809 02:19:34.900432 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:35835
--webserver_interface=127.11.93.190
--webserver_port=0
--builtin_ntp_servers=127.11.93.148:43509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:35835
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786241951749734-11638-0/testchainca.cert with env {}
W20260809 02:19:34.982229 17424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:34.982434 17424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:34.982456 17424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:34.983652 17424 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:19:34.983696 17424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:34.983709 17424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:34.983726 17424 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:19:34.983785 17424 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 02:19:34.983803 17424 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 02:19:34.983822 17424 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260809 02:19:34.985399 17424 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:43509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:35835
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:35835
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786241951749734-11638-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17424
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:34.985633 17424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:34.985841 17424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:34.990675 17429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:34.990715 17430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:34.990712 17424 server_base.cc:1034] running on GCE node
W20260809 02:19:34.990694 17432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:34.991158 17424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:34.991482 17424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:34.992648 17424 hybrid_clock.cc:648] HybridClock initialized: now 1786241974992635 us; error 46 us; skew 500 ppm
I20260809 02:19:34.993826 17424 webserver.cc:460] Webserver started at http://127.11.93.190:46537/ using document root <none> and password file <none>
I20260809 02:19:34.994083 17424 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:34.994154 17424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:34.994309 17424 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:34.995455 17424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "b770baf313aa468b920df3f3efcc8147"
format_stamp: "Formatted at 2026-08-09 02:19:34 on dist-test-slave-w206"
server_key: "5640b5e24e9d4ac35b9fe55733fc5e6f"
server_key_iv: "1c4c88b228d2bcadb36c4cedb06d35c6"
server_key_version: "encryptionkey@0"
I20260809 02:19:34.995821 17424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "b770baf313aa468b920df3f3efcc8147"
format_stamp: "Formatted at 2026-08-09 02:19:34 on dist-test-slave-w206"
server_key: "5640b5e24e9d4ac35b9fe55733fc5e6f"
server_key_iv: "1c4c88b228d2bcadb36c4cedb06d35c6"
server_key_version: "encryptionkey@0"
I20260809 02:19:34.997215 17424 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260809 02:19:34.998049 17438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:34.998270 17424 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:34.998382 17424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "b770baf313aa468b920df3f3efcc8147"
format_stamp: "Formatted at 2026-08-09 02:19:34 on dist-test-slave-w206"
server_key: "5640b5e24e9d4ac35b9fe55733fc5e6f"
server_key_iv: "1c4c88b228d2bcadb36c4cedb06d35c6"
server_key_version: "encryptionkey@0"
I20260809 02:19:34.998461 17424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:35.014768 17424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:35.015208 17424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:35.015372 17424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:35.019307 17424 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:35835
I20260809 02:19:35.019345 17491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:35835 every 8 connection(s)
I20260809 02:19:35.019721 17424 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:19:35.020738 17492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:35.023092 17492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b770baf313aa468b920df3f3efcc8147: Bootstrap starting.
I20260809 02:19:35.023659 17492 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b770baf313aa468b920df3f3efcc8147: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:35.023959 17492 log.cc:824] T 00000000000000000000000000000000 P b770baf313aa468b920df3f3efcc8147: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:35.024643 17492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b770baf313aa468b920df3f3efcc8147: No bootstrap required, opened a new log
I20260809 02:19:35.024987 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 17424
I20260809 02:19:35.025102 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:19:35.025317 11638 external_mini_cluster.cc:1428] Setting key 7c6a9fc864b760e971b5cf7d19d67445
I20260809 02:19:35.026863 17492 raft_consensus.cc:348] T 00000000000000000000000000000000 P b770baf313aa468b920df3f3efcc8147 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b770baf313aa468b920df3f3efcc8147" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 35835 } }
I20260809 02:19:35.027055 17492 raft_consensus.cc:374] T 00000000000000000000000000000000 P b770baf313aa468b920df3f3efcc8147 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:35.027084 17492 raft_consensus.cc:729] T 00000000000000000000000000000000 P b770baf313aa468b920df3f3efcc8147 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b770baf313aa468b920df3f3efcc8147, State: Initialized, Role: FOLLOWER
I20260809 02:19:35.027230 17492 consensus_queue.cc:260] T 00000000000000000000000000000000 P b770baf313aa468b920df3f3efcc8147 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b770baf313aa468b920df3f3efcc8147" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 35835 } }
I20260809 02:19:35.027307 17492 raft_consensus.cc:388] T 00000000000000000000000000000000 P b770baf313aa468b920df3f3efcc8147 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:19:35.027329 17492 raft_consensus.cc:482] T 00000000000000000000000000000000 P b770baf313aa468b920df3f3efcc8147 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:19:35.027395 17492 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b770baf313aa468b920df3f3efcc8147 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:35.027927 17492 raft_consensus.cc:504] T 00000000000000000000000000000000 P b770baf313aa468b920df3f3efcc8147 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b770baf313aa468b920df3f3efcc8147" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 35835 } }
I20260809 02:19:35.028012 17492 leader_election.cc:302] T 00000000000000000000000000000000 P b770baf313aa468b920df3f3efcc8147 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b770baf313aa468b920df3f3efcc8147; no voters:
I20260809 02:19:35.028261 17492 leader_election.cc:288] T 00000000000000000000000000000000 P b770baf313aa468b920df3f3efcc8147 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:19:35.028291 17497 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b770baf313aa468b920df3f3efcc8147 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:35.028398 17497 raft_consensus.cc:686] T 00000000000000000000000000000000 P b770baf313aa468b920df3f3efcc8147 [term 1 LEADER]: Becoming Leader. State: Replica: b770baf313aa468b920df3f3efcc8147, State: Running, Role: LEADER
I20260809 02:19:35.028481 17497 consensus_queue.cc:237] T 00000000000000000000000000000000 P b770baf313aa468b920df3f3efcc8147 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b770baf313aa468b920df3f3efcc8147" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 35835 } }
I20260809 02:19:35.028528 17492 sys_catalog.cc:564] T 00000000000000000000000000000000 P b770baf313aa468b920df3f3efcc8147 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:19:35.028803 17498 sys_catalog.cc:455] T 00000000000000000000000000000000 P b770baf313aa468b920df3f3efcc8147 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b770baf313aa468b920df3f3efcc8147" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b770baf313aa468b920df3f3efcc8147" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 35835 } } }
I20260809 02:19:35.028893 17498 sys_catalog.cc:458] T 00000000000000000000000000000000 P b770baf313aa468b920df3f3efcc8147 [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:35.029062 17500 sys_catalog.cc:455] T 00000000000000000000000000000000 P b770baf313aa468b920df3f3efcc8147 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b770baf313aa468b920df3f3efcc8147. Latest consensus state: current_term: 1 leader_uuid: "b770baf313aa468b920df3f3efcc8147" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b770baf313aa468b920df3f3efcc8147" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 35835 } } }
I20260809 02:19:35.029116 17500 sys_catalog.cc:458] T 00000000000000000000000000000000 P b770baf313aa468b920df3f3efcc8147 [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:35.029196 17502 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:19:35.029781 17502 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:19:35.031612 17502 catalog_manager.cc:1347] Generated new cluster ID: b5a2f2f1bf6048ce94d302501c8f928c
I20260809 02:19:35.031667 17502 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:19:35.031958 17496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:35.025848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46446 (local address 127.11.93.190:35835)
0809 02:19:35.026085 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:35.026092 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:35.026117 (+ 25us) server_negotiation.cc:407] Connection header received
0809 02:19:35.026519 (+ 402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:35.026525 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:35.026579 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:35.026720 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:35.026947 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:35.028373 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:35.029489 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:35.030186 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:35.030621 (+ 435us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:35.031053 (+ 432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:35.031056 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:35.031057 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:19:35.031273 (+ 216us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:35.031313 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:19:35.031327 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:35.031643 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:35.031674 (+ 31us) server_negotiation.cc:299] Negotiation successful
0809 02:19:35.031752 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":100,"threads_started":1}
I20260809 02:19:35.032891 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:19:35.041945 17502 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:19:35.042621 17502 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:19:35.053988 17502 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b770baf313aa468b920df3f3efcc8147: Generated new TSK 0
I20260809 02:19:35.054196 17502 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:19:35.113093 17496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:35.062909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46456 (local address 127.11.93.190:35835)
0809 02:19:35.062961 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:35.062963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:35.063086 (+ 123us) server_negotiation.cc:407] Connection header received
0809 02:19:35.063148 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:35.063149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:35.063203 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:35.063271 (+ 68us) server_negotiation.cc:226] Negotiated authn=JWT
0809 02:19:35.063421 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:35.063938 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:35.065080 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:35.065305 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:35.065365 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:35.065563 (+ 198us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 02:19:35.112868 (+ 47305us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 02:19:35.113032 (+ 164us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46456: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":28}
W20260809 02:19:35.113190 17496 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46456: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260809 02:19:35.113324 17524 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:35.062809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:35835 (local address 127.0.0.1:46456)
0809 02:19:35.063008 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:35.063019 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:35.063088 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:35.063285 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:35.063286 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:35.063289 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0809 02:19:35.063345 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:35.063347 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:35.064015 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:35.064016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:35.064973 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:35.064976 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:35.065399 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:35.065400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:35.065461 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:35.065466 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 02:19:35.113038 (+ 47572us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 02:19:35.113198 (+ 160us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.93.190:35835: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":114,"threads_started":1}
I20260809 02:19:35.113724 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 17424
2026-08-09T02:19:35Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (240 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (91 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (89 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:19:35 dist-test-slave-w206 krb5kdc[17536](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:19:35 dist-test-slave-w206 krb5kdc[17536](info): set up 2 sockets
Aug 09 02:19:35 dist-test-slave-w206 krb5kdc[17536](info): commencing operation
krb5kdc: starting...
W20260809 02:19:36.374305 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:19:36 dist-test-slave-w206 krb5kdc[17536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241976, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:19:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:19:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:19:36.501180 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:40455
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:37131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:40455
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:36.582717 17549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:36.582927 17549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:36.582949 17549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:36.584069 17549 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:19:36.584105 17549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:36.584120 17549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:36.584132 17549 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:19:36.584144 17549 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:19:36.585494 17549 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:37131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:40455
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:40455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17549
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:36.585677 17549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:36.585914 17549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:19:36.591027 17549 server_base.cc:1034] running on GCE node
W20260809 02:19:36.591053 17556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:36.591059 17554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:36.591140 17559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:36.591531 17549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:36.591820 17549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:36.592988 17549 hybrid_clock.cc:648] HybridClock initialized: now 1786241976592982 us; error 38 us; skew 500 ppm
Aug 09 02:19:36 dist-test-slave-w206 krb5kdc[17536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241976, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:36.600683 17549 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:19:36.601171 17549 webserver.cc:460] Webserver started at http://127.11.93.190:44847/ using document root <none> and password file <none>
I20260809 02:19:36.601423 17549 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:36.601495 17549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:36.601647 17549 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:36.602800 17549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "fbe3cadfe8a64dd4919d443206ea0141"
format_stamp: "Formatted at 2026-08-09 02:19:36 on dist-test-slave-w206"
server_key: "dff78733a5799b97ed1148e22984f60c"
server_key_iv: "a06644a2f32c026f5c99d357bf241685"
server_key_version: "encryptionkey@0"
I20260809 02:19:36.603197 17549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "fbe3cadfe8a64dd4919d443206ea0141"
format_stamp: "Formatted at 2026-08-09 02:19:36 on dist-test-slave-w206"
server_key: "dff78733a5799b97ed1148e22984f60c"
server_key_iv: "a06644a2f32c026f5c99d357bf241685"
server_key_version: "encryptionkey@0"
I20260809 02:19:36.604604 17549 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:19:36.605355 17567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:36.605533 17549 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:36.605643 17549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "fbe3cadfe8a64dd4919d443206ea0141"
format_stamp: "Formatted at 2026-08-09 02:19:36 on dist-test-slave-w206"
server_key: "dff78733a5799b97ed1148e22984f60c"
server_key_iv: "a06644a2f32c026f5c99d357bf241685"
server_key_version: "encryptionkey@0"
I20260809 02:19:36.605717 17549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:36.613996 17549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:36.616019 17549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:36.616176 17549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:36.620080 17549 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:40455
I20260809 02:19:36.620128 17621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:40455 every 8 connection(s)
I20260809 02:19:36.620498 17549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:19:36.621392 17622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:36.623725 17622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbe3cadfe8a64dd4919d443206ea0141: Bootstrap starting.
I20260809 02:19:36.624303 17622 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbe3cadfe8a64dd4919d443206ea0141: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:36.624604 17622 log.cc:824] T 00000000000000000000000000000000 P fbe3cadfe8a64dd4919d443206ea0141: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:36.625301 17622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbe3cadfe8a64dd4919d443206ea0141: No bootstrap required, opened a new log
I20260809 02:19:36.626462 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 17549
I20260809 02:19:36.626570 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:19:36.626758 11638 external_mini_cluster.cc:1428] Setting key f5ddad198f53b1bdc73b62c803aedc26
I20260809 02:19:36.627372 17622 raft_consensus.cc:348] T 00000000000000000000000000000000 P fbe3cadfe8a64dd4919d443206ea0141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbe3cadfe8a64dd4919d443206ea0141" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40455 } }
I20260809 02:19:36.627548 17622 raft_consensus.cc:374] T 00000000000000000000000000000000 P fbe3cadfe8a64dd4919d443206ea0141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:36.627575 17622 raft_consensus.cc:729] T 00000000000000000000000000000000 P fbe3cadfe8a64dd4919d443206ea0141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbe3cadfe8a64dd4919d443206ea0141, State: Initialized, Role: FOLLOWER
I20260809 02:19:36.627723 17622 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbe3cadfe8a64dd4919d443206ea0141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbe3cadfe8a64dd4919d443206ea0141" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40455 } }
I20260809 02:19:36.627800 17622 raft_consensus.cc:388] T 00000000000000000000000000000000 P fbe3cadfe8a64dd4919d443206ea0141 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:19:36.627822 17622 raft_consensus.cc:482] T 00000000000000000000000000000000 P fbe3cadfe8a64dd4919d443206ea0141 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:19:36.627895 17622 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fbe3cadfe8a64dd4919d443206ea0141 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:36.628738 17622 raft_consensus.cc:504] T 00000000000000000000000000000000 P fbe3cadfe8a64dd4919d443206ea0141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbe3cadfe8a64dd4919d443206ea0141" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40455 } }
I20260809 02:19:36.628861 17622 leader_election.cc:302] T 00000000000000000000000000000000 P fbe3cadfe8a64dd4919d443206ea0141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fbe3cadfe8a64dd4919d443206ea0141; no voters:
I20260809 02:19:36.629083 17622 leader_election.cc:288] T 00000000000000000000000000000000 P fbe3cadfe8a64dd4919d443206ea0141 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:19:36.629118 17627 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fbe3cadfe8a64dd4919d443206ea0141 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:36.629231 17627 raft_consensus.cc:686] T 00000000000000000000000000000000 P fbe3cadfe8a64dd4919d443206ea0141 [term 1 LEADER]: Becoming Leader. State: Replica: fbe3cadfe8a64dd4919d443206ea0141, State: Running, Role: LEADER
I20260809 02:19:36.629359 17622 sys_catalog.cc:564] T 00000000000000000000000000000000 P fbe3cadfe8a64dd4919d443206ea0141 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:19:36.629385 17627 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbe3cadfe8a64dd4919d443206ea0141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbe3cadfe8a64dd4919d443206ea0141" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40455 } }
I20260809 02:19:36.629709 17627 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbe3cadfe8a64dd4919d443206ea0141 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbe3cadfe8a64dd4919d443206ea0141. Latest consensus state: current_term: 1 leader_uuid: "fbe3cadfe8a64dd4919d443206ea0141" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbe3cadfe8a64dd4919d443206ea0141" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40455 } } }
I20260809 02:19:36.629793 17627 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbe3cadfe8a64dd4919d443206ea0141 [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:36.629729 17628 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbe3cadfe8a64dd4919d443206ea0141 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fbe3cadfe8a64dd4919d443206ea0141" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbe3cadfe8a64dd4919d443206ea0141" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40455 } } }
I20260809 02:19:36.629941 17628 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbe3cadfe8a64dd4919d443206ea0141 [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:36.630034 17634 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:19:36.630582 17634 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:19:36.632305 17634 catalog_manager.cc:1347] Generated new cluster ID: db3d5eefcd5b4b488ea6c0e0c69629cf
I20260809 02:19:36.632356 17634 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 02:19:36 dist-test-slave-w206 krb5kdc[17536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241976, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:36.638481 17626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:36.627329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56312 (local address 127.11.93.190:40455)
0809 02:19:36.627538 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:36.627563 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:36.627599 (+ 36us) server_negotiation.cc:407] Connection header received
0809 02:19:36.627734 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:36.627739 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:36.627781 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:36.627929 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:36.628676 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:36.629978 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:36.631165 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:36.631764 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:36.631872 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:36.634706 (+ 2834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:36.634710 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:36.634710 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:36.634722 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:36.636765 (+ 2043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:36.637159 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:36.637162 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:36.637163 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:36.637335 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:36.637548 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:36.637549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:36.637550 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:36.637864 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:36.638051 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:36.638122 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 02:19:36.638278 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":102,"threads_started":1}
I20260809 02:19:36.653059 17634 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:19:36.653808 17634 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:19:36.657599 17634 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fbe3cadfe8a64dd4919d443206ea0141: Generated new TSK 0
I20260809 02:19:36.657799 17634 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.93.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
I20260809 02:19:36.689690 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:40455
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:37131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:36.786477 17649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:36.786681 17649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:36.786705 17649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:36.787951 17649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:36.787997 17649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:36.788023 17649 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:19:36.789438 17649 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:37131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:40455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17649
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:36.789615 17649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:36.789779 17649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:36.794612 17654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:36.794632 17655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:36.794636 17657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:36.794936 17649 server_base.cc:1034] running on GCE node
I20260809 02:19:36.795167 17649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:36.795369 17649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:36.796594 17649 hybrid_clock.cc:648] HybridClock initialized: now 1786241976796581 us; error 30 us; skew 500 ppm
Aug 09 02:19:36 dist-test-slave-w206 krb5kdc[17536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241976, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:36.799425 17649 init.cc:377] Logged in from keytab as kudu/127.11.93.129@KRBTEST.COM (short username kudu)
I20260809 02:19:36.799851 17649 webserver.cc:460] Webserver started at http://127.11.93.129:42643/ using document root <none> and password file <none>
I20260809 02:19:36.800104 17649 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:36.800174 17649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:36.800324 17649 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:36.801348 17649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "85ffcd8d62fa4841b7983bd5bf4f5ab3"
format_stamp: "Formatted at 2026-08-09 02:19:36 on dist-test-slave-w206"
server_key: "312736feb3270a27f5a73bfe245c009b"
server_key_iv: "8349524da26f8fd6c6e068e38726e012"
server_key_version: "encryptionkey@0"
I20260809 02:19:36.801764 17649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "85ffcd8d62fa4841b7983bd5bf4f5ab3"
format_stamp: "Formatted at 2026-08-09 02:19:36 on dist-test-slave-w206"
server_key: "312736feb3270a27f5a73bfe245c009b"
server_key_iv: "8349524da26f8fd6c6e068e38726e012"
server_key_version: "encryptionkey@0"
I20260809 02:19:36.803123 17649 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:19:36.803848 17664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:36.804024 17649 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:19:36.804122 17649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "85ffcd8d62fa4841b7983bd5bf4f5ab3"
format_stamp: "Formatted at 2026-08-09 02:19:36 on dist-test-slave-w206"
server_key: "312736feb3270a27f5a73bfe245c009b"
server_key_iv: "8349524da26f8fd6c6e068e38726e012"
server_key_version: "encryptionkey@0"
I20260809 02:19:36.804209 17649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:36.828444 17649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:36.831084 17649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:36.831259 17649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:36.831516 17649 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:36.831826 17649 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:36.831879 17649 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:36.831916 17649 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:36.831945 17649 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:36.837805 17649 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:41247
I20260809 02:19:36.837854 17788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:41247 every 8 connection(s)
I20260809 02:19:36.838164 17649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
Aug 09 02:19:36 dist-test-slave-w206 krb5kdc[17536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241976, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:36.846179 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 17649
I20260809 02:19:36.846297 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:19:36.846501 11638 external_mini_cluster.cc:1428] Setting key 1b0d1cd4990d200ddf8d11d40e762ab1
I20260809 02:19:36.847450 17626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:36.838884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:55297 (local address 127.11.93.190:40455)
0809 02:19:36.838928 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:36.838930 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:36.839179 (+ 249us) server_negotiation.cc:407] Connection header received
0809 02:19:36.840121 (+ 942us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:36.840123 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:36.840137 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:36.840187 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:36.840771 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:36.841293 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:36.842252 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:36.842446 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:36.842498 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:36.844644 (+ 2146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:36.844646 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:36.844646 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:36.844655 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:36.845887 (+ 1232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:36.846355 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:36.846357 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:36.846357 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:36.846422 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:36.846693 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:36.846695 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:36.846695 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:36.846855 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:36.846916 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:36.847275 (+ 359us) server_negotiation.cc:299] Negotiation successful
0809 02:19:36.847370 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 02:19:36.847678 17791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:36.838873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40455 (local address 127.11.93.129:55297)
0809 02:19:36.839074 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:36.839108 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:36.840025 (+ 917us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:36.840247 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:36.840250 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:36.840505 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:36.840696 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:36.840699 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:36.841385 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:36.841386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:36.842156 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:36.842158 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:36.842520 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:36.842521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:36.842623 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:36.843196 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:36.843204 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:36.844537 (+ 1333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:36.845994 (+ 1457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:36.846001 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:36.846003 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:36.846249 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:36.846492 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:36.846493 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:36.846493 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:36.846637 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:36.846918 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:36.846925 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:36.847100 (+ 175us) client_negotiation.cc:769] Sending connection context
0809 02:19:36.847228 (+ 128us) client_negotiation.cc:240] Negotiation successful
0809 02:19:36.847414 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":146,"threads_started":1}
I20260809 02:19:36.848196 17789 heartbeater.cc:347] Connected to a master server at 127.11.93.190:40455
I20260809 02:19:36.848310 17789 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:36.848483 17789 heartbeater.cc:511] Master 127.11.93.190:40455 requested a full tablet report, sending...
I20260809 02:19:36.848994 17585 ts_manager.cc:194] Registered new tserver with Master: 85ffcd8d62fa4841b7983bd5bf4f5ab3 (127.11.93.129:41247)
I20260809 02:19:36.849931 17585 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:55297
WARNING: no policy specified for kudu/127.11.93.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
I20260809 02:19:36.873384 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:40455
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:37131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:36.954200 17795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:36.954401 17795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:36.954424 17795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:36.955641 17795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:36.955685 17795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:36.955711 17795 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:19:36.957286 17795 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:37131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:40455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17795
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:36.957525 17795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:36.957779 17795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:36.962944 17801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:36.962908 17803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:36.962908 17800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:36.962961 17795 server_base.cc:1034] running on GCE node
I20260809 02:19:36.963557 17795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:36.963831 17795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:36.965004 17795 hybrid_clock.cc:648] HybridClock initialized: now 1786241976964988 us; error 28 us; skew 500 ppm
Aug 09 02:19:36 dist-test-slave-w206 krb5kdc[17536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241976, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:36.967625 17795 init.cc:377] Logged in from keytab as kudu/127.11.93.130@KRBTEST.COM (short username kudu)
I20260809 02:19:36.967999 17795 webserver.cc:460] Webserver started at http://127.11.93.130:45693/ using document root <none> and password file <none>
I20260809 02:19:36.968194 17795 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:36.968302 17795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:36.968427 17795 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:36.969406 17795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "49e281da27284a95938cf06464de6260"
format_stamp: "Formatted at 2026-08-09 02:19:36 on dist-test-slave-w206"
server_key: "cc15ea0465b04005f7a01354e113a564"
server_key_iv: "dc30242f0f57e9849ed95369b949848c"
server_key_version: "encryptionkey@0"
I20260809 02:19:36.969709 17795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "49e281da27284a95938cf06464de6260"
format_stamp: "Formatted at 2026-08-09 02:19:36 on dist-test-slave-w206"
server_key: "cc15ea0465b04005f7a01354e113a564"
server_key_iv: "dc30242f0f57e9849ed95369b949848c"
server_key_version: "encryptionkey@0"
I20260809 02:19:36.971067 17795 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 02:19:36.971846 17810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:36.972016 17795 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:19:36.972105 17795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "49e281da27284a95938cf06464de6260"
format_stamp: "Formatted at 2026-08-09 02:19:36 on dist-test-slave-w206"
server_key: "cc15ea0465b04005f7a01354e113a564"
server_key_iv: "dc30242f0f57e9849ed95369b949848c"
server_key_version: "encryptionkey@0"
I20260809 02:19:36.972157 17795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:36.983968 17795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:36.986222 17795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:36.986341 17795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:36.986527 17795 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:36.986838 17795 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:36.986874 17795 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:36.986897 17795 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:36.986910 17795 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:36.992858 17795 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:38275
I20260809 02:19:36.992921 17930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:38275 every 8 connection(s)
I20260809 02:19:36.993240 17795 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:19:36.998898 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 17795
I20260809 02:19:36.999035 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:19:36.999240 11638 external_mini_cluster.cc:1428] Setting key e63fc02e4f9a6a2fdd8a397ecb398f4e
Aug 09 02:19:36 dist-test-slave-w206 krb5kdc[17536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241976, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:37.003331 17626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:36.994163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:55675 (local address 127.11.93.190:40455)
0809 02:19:36.994228 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:36.994229 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:36.994417 (+ 188us) server_negotiation.cc:407] Connection header received
0809 02:19:36.995443 (+ 1026us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:36.995444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:36.995454 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:36.995516 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:36.996132 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:36.996628 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:36.997594 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:36.997772 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:36.997822 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:37.000411 (+ 2589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:37.000412 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:37.000412 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:37.000418 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:37.001883 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:37.002288 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:37.002289 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:37.002290 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:37.002353 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:37.002616 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:37.002617 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:37.002617 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:37.002740 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:37.002819 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:37.003150 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 02:19:37.003241 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 02:19:37.003541 17933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:36.994110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40455 (local address 127.11.93.130:55675)
0809 02:19:36.994280 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:36.994323 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:36.995350 (+ 1027us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:36.995592 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:36.995595 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:36.995859 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:36.996058 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:36.996062 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:36.996709 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:36.996710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:36.997517 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:36.997519 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:36.997842 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:36.997843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:36.997938 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:36.998402 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:36.998411 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:37.000320 (+ 1909us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:37.001965 (+ 1645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:37.001971 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:37.001974 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:37.002207 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:37.002424 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:37.002425 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:37.002425 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:37.002541 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:37.002810 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:37.002817 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:37.002958 (+ 141us) client_negotiation.cc:769] Sending connection context
0809 02:19:37.003119 (+ 161us) client_negotiation.cc:240] Negotiation successful
0809 02:19:37.003282 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":95,"threads_started":1}
I20260809 02:19:37.004037 17931 heartbeater.cc:347] Connected to a master server at 127.11.93.190:40455
I20260809 02:19:37.004144 17931 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:37.004351 17931 heartbeater.cc:511] Master 127.11.93.190:40455 requested a full tablet report, sending...
I20260809 02:19:37.004765 17585 ts_manager.cc:194] Registered new tserver with Master: 49e281da27284a95938cf06464de6260 (127.11.93.130:38275)
I20260809 02:19:37.005332 17585 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:55675
WARNING: no policy specified for kudu/127.11.93.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
I20260809 02:19:37.026399 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:40455
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:37131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:37.108176 17936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:37.108412 17936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:37.108438 17936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:37.109647 17936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:37.109690 17936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:37.109719 17936 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:19:37.111255 17936 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:37131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:40455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17936
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:37.111449 17936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:37.111622 17936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:37.116556 17941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:37.116555 17942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:37.116739 17936 server_base.cc:1034] running on GCE node
W20260809 02:19:37.116555 17944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:37.116998 17936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:37.117265 17936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:37.118427 17936 hybrid_clock.cc:648] HybridClock initialized: now 1786241977118408 us; error 28 us; skew 500 ppm
Aug 09 02:19:37 dist-test-slave-w206 krb5kdc[17536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241977, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:37.121134 17936 init.cc:377] Logged in from keytab as kudu/127.11.93.131@KRBTEST.COM (short username kudu)
I20260809 02:19:37.121629 17936 webserver.cc:460] Webserver started at http://127.11.93.131:44817/ using document root <none> and password file <none>
I20260809 02:19:37.121840 17936 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:37.121879 17936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:37.121971 17936 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:37.122961 17936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "3ed5fbbf042f45c2b3fbc474f5e0a147"
format_stamp: "Formatted at 2026-08-09 02:19:37 on dist-test-slave-w206"
server_key: "857a1a1c571805ca2fa051a67a601baf"
server_key_iv: "eef3f809efd344f3c263bd0ad5d3581e"
server_key_version: "encryptionkey@0"
I20260809 02:19:37.123361 17936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "3ed5fbbf042f45c2b3fbc474f5e0a147"
format_stamp: "Formatted at 2026-08-09 02:19:37 on dist-test-slave-w206"
server_key: "857a1a1c571805ca2fa051a67a601baf"
server_key_iv: "eef3f809efd344f3c263bd0ad5d3581e"
server_key_version: "encryptionkey@0"
I20260809 02:19:37.124634 17936 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:19:37.125391 17951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:37.125581 17936 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:19:37.125691 17936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "3ed5fbbf042f45c2b3fbc474f5e0a147"
format_stamp: "Formatted at 2026-08-09 02:19:37 on dist-test-slave-w206"
server_key: "857a1a1c571805ca2fa051a67a601baf"
server_key_iv: "eef3f809efd344f3c263bd0ad5d3581e"
server_key_version: "encryptionkey@0"
I20260809 02:19:37.125767 17936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:37.137066 17936 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:37.139459 17936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:37.139624 17936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:37.139884 17936 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:37.140229 17936 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:37.140264 17936 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:37.140287 17936 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:37.140300 17936 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:37.145975 17936 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:45199
I20260809 02:19:37.146056 18072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:45199 every 8 connection(s)
I20260809 02:19:37.146385 17936 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:19:37.151870 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 17936
I20260809 02:19:37.151957 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:19:37.152172 11638 external_mini_cluster.cc:1428] Setting key af5030367d322fe0058a7b8c504a3185
Aug 09 02:19:37 dist-test-slave-w206 krb5kdc[17536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241977, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:37.156422 17626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:37.147275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:40979 (local address 127.11.93.190:40455)
0809 02:19:37.147320 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:37.147325 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:37.147577 (+ 252us) server_negotiation.cc:407] Connection header received
0809 02:19:37.148574 (+ 997us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:37.148576 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:37.148590 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:37.148641 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:37.149275 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:37.149776 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:37.150803 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:37.151065 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:37.151150 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:37.153610 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:37.153612 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:37.153612 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:37.153618 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:37.154940 (+ 1322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:37.155379 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:37.155380 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:37.155381 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:37.155448 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:37.155684 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:37.155685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:37.155685 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:37.155810 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:37.155879 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:37.156152 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 02:19:37.156279 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 02:19:37.156504 18076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:37.147252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40455 (local address 127.11.93.131:40979)
0809 02:19:37.147444 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:37.147481 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:37.148446 (+ 965us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:37.148709 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:37.148713 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:37.148990 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:37.149174 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:37.149178 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:37.149876 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:37.149877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:37.150703 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:37.150705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:37.151164 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:37.151165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:37.151301 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:37.151856 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:37.151864 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:37.153525 (+ 1661us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:37.155066 (+ 1541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:37.155072 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:37.155074 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:37.155291 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:37.155520 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:37.155520 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:37.155520 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:37.155621 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:37.155888 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:37.155893 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:37.156008 (+ 115us) client_negotiation.cc:769] Sending connection context
0809 02:19:37.156091 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 02:19:37.156211 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":93,"threads_started":1}
I20260809 02:19:37.157006 18073 heartbeater.cc:347] Connected to a master server at 127.11.93.190:40455
I20260809 02:19:37.157094 18073 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:37.157295 18073 heartbeater.cc:511] Master 127.11.93.190:40455 requested a full tablet report, sending...
I20260809 02:19:37.157832 17585 ts_manager.cc:194] Registered new tserver with Master: 3ed5fbbf042f45c2b3fbc474f5e0a147 (127.11.93.131:45199)
I20260809 02:19:37.158227 17585 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:40979
I20260809 02:19:37.164350 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/test-admin.keytab.
Aug 09 02:19:37 dist-test-slave-w206 krb5kdc[17536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241977, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:37.179649 11638 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260809 02:19:37.181401 11638 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/krb5cc' of type FILE
W20260809 02:19:37.181411 18082 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:37.180457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46102 (local address 127.11.93.129:41247)
0809 02:19:37.180658 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:37.180662 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:37.180673 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:19:37.180708 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:37.180710 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:37.180724 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:37.180795 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:37.181321 (+ 526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46102: BlockingRecv error: recv got EOF from 127.0.0.1:46102 (error 108)
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":93,"threads_started":1}
Aug 09 02:19:37 dist-test-slave-w206 krb5kdc[17536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241977, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:37.182399 11638 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 02:19:37 dist-test-slave-w206 krb5kdc[17536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241977, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:37.183285 11638 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 02:19:37 dist-test-slave-w206 krb5kdc[17536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241977, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.129@KRBTEST.COM
I20260809 02:19:37.191083 18082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:37.183774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46114 (local address 127.11.93.129:41247)
0809 02:19:37.183818 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:37.183820 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:37.183870 (+ 50us) server_negotiation.cc:407] Connection header received
0809 02:19:37.183924 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:37.183924 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:37.183933 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:37.183981 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:37.184353 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:37.185082 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:37.185826 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:37.186136 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:37.186189 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:37.188343 (+ 2154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:37.188351 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:37.188351 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:37.188358 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:37.190009 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:37.190350 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:37.190353 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:37.190353 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:37.190415 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:37.190583 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:37.190584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:37.190584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:37.190709 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:37.190823 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:37.190882 (+ 59us) server_negotiation.cc:299] Negotiation successful
0809 02:19:37.190947 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 02:19:37.192904 18082 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:37.192388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46116 (local address 127.11.93.129:41247)
0809 02:19:37.192427 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:37.192429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:37.192472 (+ 43us) server_negotiation.cc:407] Connection header received
0809 02:19:37.192521 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:37.192521 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:37.192529 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:37.192575 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:37.192835 (+ 260us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46116: BlockingRecv error: recv got EOF from 127.0.0.1:46116 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260809 02:19:37.193028 11638 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/krb5cc' of type FILE
Aug 09 02:19:37 dist-test-slave-w206 krb5kdc[17536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241977, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:37.193980 11638 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 02:19:37 dist-test-slave-w206 krb5kdc[17536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241977, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:37.194823 11638 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 02:19:37 dist-test-slave-w206 krb5kdc[17536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241977, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.129@KRBTEST.COM
I20260809 02:19:37.201615 18082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:37.195417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46124 (local address 127.11.93.129:41247)
0809 02:19:37.195459 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:37.195460 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:37.195496 (+ 36us) server_negotiation.cc:407] Connection header received
0809 02:19:37.195553 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:37.195554 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:37.195561 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:37.195600 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:37.195937 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:37.196406 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:37.197035 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:37.197219 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:37.197268 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:37.199276 (+ 2008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:37.199277 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:37.199278 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:37.199285 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:37.200462 (+ 1177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:37.200807 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:37.200808 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:37.200808 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:37.200866 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:37.201079 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:37.201079 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:37.201080 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:37.201174 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:37.201277 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:37.201441 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 02:19:37.201519 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260809 02:19:37.203125 18082 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:37.202621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46136 (local address 127.11.93.129:41247)
0809 02:19:37.202656 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:37.202658 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:37.202686 (+ 28us) server_negotiation.cc:407] Connection header received
0809 02:19:37.202740 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:37.202740 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:37.202747 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:37.202790 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:37.203078 (+ 288us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46136: BlockingRecv error: recv got EOF from 127.0.0.1:46136 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260809 02:19:37.203262 11638 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786241951749734-11638-0/krb5kdc/krb5cc' of type FILE
Aug 09 02:19:37 dist-test-slave-w206 krb5kdc[17536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241977, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:37.204164 11638 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 02:19:37 dist-test-slave-w206 krb5kdc[17536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241977, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:37.205098 11638 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 02:19:37 dist-test-slave-w206 krb5kdc[17536](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241977, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.129@KRBTEST.COM
I20260809 02:19:37.212715 18082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:37.205618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46140 (local address 127.11.93.129:41247)
0809 02:19:37.205694 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:37.205696 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:37.205726 (+ 30us) server_negotiation.cc:407] Connection header received
0809 02:19:37.205775 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:37.205776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:37.205784 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:37.205840 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:37.206213 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:37.206840 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:37.207552 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:37.207799 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:37.207869 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:37.210443 (+ 2574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:37.210444 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:37.210444 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:37.210450 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:37.211795 (+ 1345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:37.212121 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:37.212122 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:37.212122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:37.212173 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:37.212336 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:37.212337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:37.212337 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:37.212426 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:37.212497 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:37.212600 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 02:19:37.212656 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 02:19:37.213410 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 17649
I20260809 02:19:37.219589 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 17795
I20260809 02:19:37.227046 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 17936
I20260809 02:19:37.233042 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 17549
2026-08-09T02:19:37Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (1940 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:19:37 dist-test-slave-w206 krb5kdc[18095](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:19:37 dist-test-slave-w206 krb5kdc[18095](info): set up 2 sockets
Aug 09 02:19:37 dist-test-slave-w206 krb5kdc[18095](info): commencing operation
krb5kdc: starting...
W20260809 02:19:38.327149 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:19:38 dist-test-slave-w206 krb5kdc[18095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:19:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:19:38Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.190.keytab.
Entry for principal oryx/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.190.keytab.
I20260809 02:19:38.453985 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:34587
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.190.keytab
--principal=oryx/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:34587
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:38.539773 18108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:38.540050 18108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:38.540091 18108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:38.541323 18108 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:19:38.541409 18108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:38.541440 18108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:38.541472 18108 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:19:38.541494 18108 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:19:38.543046 18108 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:34587
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.190.keytab
--principal=oryx/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:34587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18108
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:38.543334 18108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:38.543579 18108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:38.548746 18116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:38.548846 18108 server_base.cc:1034] running on GCE node
W20260809 02:19:38.549041 18113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:38.549037 18114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:38.549358 18108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:38.549678 18108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:38.550869 18108 hybrid_clock.cc:648] HybridClock initialized: now 1786241978550846 us; error 41 us; skew 500 ppm
Aug 09 02:19:38 dist-test-slave-w206 krb5kdc[18095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241978, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:38.553478 18108 init.cc:377] Logged in from keytab as oryx/127.11.93.190@KRBTEST.COM (short username oryx)
I20260809 02:19:38.553952 18108 webserver.cc:460] Webserver started at http://127.11.93.190:43549/ using document root <none> and password file <none>
I20260809 02:19:38.554186 18108 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:38.554255 18108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:38.554407 18108 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:38.555617 18108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "112dec87977444b9a74941e09be89dea"
format_stamp: "Formatted at 2026-08-09 02:19:38 on dist-test-slave-w206"
server_key: "57200eaf6077772c9d673adb0ef1caa6"
server_key_iv: "c64371c10cc52f9d7640cb52da43b797"
server_key_version: "encryptionkey@0"
I20260809 02:19:38.556005 18108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "112dec87977444b9a74941e09be89dea"
format_stamp: "Formatted at 2026-08-09 02:19:38 on dist-test-slave-w206"
server_key: "57200eaf6077772c9d673adb0ef1caa6"
server_key_iv: "c64371c10cc52f9d7640cb52da43b797"
server_key_version: "encryptionkey@0"
I20260809 02:19:38.557462 18108 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:19:38.558293 18123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:38.558475 18108 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:38.558583 18108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "112dec87977444b9a74941e09be89dea"
format_stamp: "Formatted at 2026-08-09 02:19:38 on dist-test-slave-w206"
server_key: "57200eaf6077772c9d673adb0ef1caa6"
server_key_iv: "c64371c10cc52f9d7640cb52da43b797"
server_key_version: "encryptionkey@0"
I20260809 02:19:38.558660 18108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:38.569665 18108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:38.571617 18108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:38.571785 18108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:38.575896 18108 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:34587
I20260809 02:19:38.575954 18178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:34587 every 8 connection(s)
I20260809 02:19:38.576345 18108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:19:38.577368 18179 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:38.579728 18179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea: Bootstrap starting.
I20260809 02:19:38.579851 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 18108
I20260809 02:19:38.580009 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:19:38.580267 11638 external_mini_cluster.cc:1428] Setting key 7d0a24854a5d5d06b74d10f124dbe08c
I20260809 02:19:38.580482 18179 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:38.580822 18179 log.cc:824] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:38.581576 18179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea: No bootstrap required, opened a new log
I20260809 02:19:38.583837 18179 raft_consensus.cc:348] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } }
I20260809 02:19:38.584041 18179 raft_consensus.cc:374] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:38.584081 18179 raft_consensus.cc:729] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 112dec87977444b9a74941e09be89dea, State: Initialized, Role: FOLLOWER
I20260809 02:19:38.584203 18179 consensus_queue.cc:260] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } }
I20260809 02:19:38.584293 18179 raft_consensus.cc:388] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:19:38.584324 18179 raft_consensus.cc:482] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:19:38.584369 18179 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:38.585062 18179 raft_consensus.cc:504] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } }
I20260809 02:19:38.585150 18179 leader_election.cc:302] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 112dec87977444b9a74941e09be89dea; no voters:
I20260809 02:19:38.585382 18179 leader_election.cc:288] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:19:38.585398 18184 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:38.585541 18184 raft_consensus.cc:686] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [term 1 LEADER]: Becoming Leader. State: Replica: 112dec87977444b9a74941e09be89dea, State: Running, Role: LEADER
I20260809 02:19:38.585634 18184 consensus_queue.cc:237] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } }
I20260809 02:19:38.585682 18179 sys_catalog.cc:564] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:19:38.585965 18184 sys_catalog.cc:455] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "112dec87977444b9a74941e09be89dea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } }
I20260809 02:19:38.586048 18184 sys_catalog.cc:458] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:38.586195 18184 sys_catalog.cc:455] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 112dec87977444b9a74941e09be89dea. Latest consensus state: current_term: 1 leader_uuid: "112dec87977444b9a74941e09be89dea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } }
I20260809 02:19:38.586258 18184 sys_catalog.cc:458] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:38.587077 18188 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:19:38.587733 18188 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 02:19:38 dist-test-slave-w206 krb5kdc[18095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM
I20260809 02:19:38.590018 18188 catalog_manager.cc:1347] Generated new cluster ID: 89ee773d252f4feeaa259289ca4934c0
I20260809 02:19:38.590075 18188 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:19:38.593075 18182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:38.580897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45292 (local address 127.11.93.190:34587)
0809 02:19:38.581077 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:38.581087 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:38.581123 (+ 36us) server_negotiation.cc:407] Connection header received
0809 02:19:38.581631 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:38.581639 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:38.581733 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:38.581866 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:38.582707 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:38.583814 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:38.584885 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:38.585505 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:38.586054 (+ 549us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:38.589024 (+ 2970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:38.589029 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:38.589030 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:38.589054 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:38.591298 (+ 2244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:38.591733 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:38.591736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:38.591736 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:38.591856 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:38.592086 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:38.592087 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:38.592088 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:38.592423 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:38.592590 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:38.592702 (+ 112us) server_negotiation.cc:299] Negotiation successful
0809 02:19:38.592855 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":83,"threads_started":1}
I20260809 02:19:38.617359 18188 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:19:38.618211 18188 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:19:38.629258 18188 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea: Generated new TSK 0
I20260809 02:19:38.629558 18188 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.93.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.93.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.93.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.129.keytab.
Entry for principal oryx/127.11.93.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.129.keytab.
I20260809 02:19:38.673439 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:34587
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.129.keytab
--principal=oryx/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:38.769932 18206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:38.770169 18206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:38.770207 18206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:38.771409 18206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:38.771473 18206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:38.771518 18206 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:19:38.772996 18206 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.129.keytab
--principal=oryx/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:34587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:38.773270 18206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:38.773501 18206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:38.778574 18215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:38.778534 18213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:38.778541 18212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:38.778759 18206 server_base.cc:1034] running on GCE node
I20260809 02:19:38.779079 18206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:38.779320 18206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:38.780495 18206 hybrid_clock.cc:648] HybridClock initialized: now 1786241978780479 us; error 59 us; skew 500 ppm
Aug 09 02:19:38 dist-test-slave-w206 krb5kdc[18095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241978, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:38.783141 18206 init.cc:377] Logged in from keytab as oryx/127.11.93.129@KRBTEST.COM (short username oryx)
I20260809 02:19:38.783576 18206 webserver.cc:460] Webserver started at http://127.11.93.129:38995/ using document root <none> and password file <none>
I20260809 02:19:38.783766 18206 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:38.783812 18206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:38.783898 18206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:38.784858 18206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "c5f9d1717edc41209ab8ed56702e13ba"
format_stamp: "Formatted at 2026-08-09 02:19:38 on dist-test-slave-w206"
server_key: "f4877635b484ac2b725ef68d6823a3d9"
server_key_iv: "bb59ffd35351868d4fc8c8954333dc16"
server_key_version: "encryptionkey@0"
I20260809 02:19:38.785233 18206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "c5f9d1717edc41209ab8ed56702e13ba"
format_stamp: "Formatted at 2026-08-09 02:19:38 on dist-test-slave-w206"
server_key: "f4877635b484ac2b725ef68d6823a3d9"
server_key_iv: "bb59ffd35351868d4fc8c8954333dc16"
server_key_version: "encryptionkey@0"
I20260809 02:19:38.786690 18206 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:19:38.787448 18223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:38.787621 18206 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:38.787724 18206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "c5f9d1717edc41209ab8ed56702e13ba"
format_stamp: "Formatted at 2026-08-09 02:19:38 on dist-test-slave-w206"
server_key: "f4877635b484ac2b725ef68d6823a3d9"
server_key_iv: "bb59ffd35351868d4fc8c8954333dc16"
server_key_version: "encryptionkey@0"
I20260809 02:19:38.787787 18206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:38.798429 18206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:38.800688 18206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:38.800806 18206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:38.800974 18206 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:38.801270 18206 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:38.801308 18206 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:38.801329 18206 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:38.801379 18206 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:38.807098 18206 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:35047
I20260809 02:19:38.807152 18340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:35047 every 8 connection(s)
I20260809 02:19:38.807457 18206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:19:38.810088 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 18206
I20260809 02:19:38.810215 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:19:38.810447 11638 external_mini_cluster.cc:1428] Setting key dead5c1f9eae86015874dca7420989f3
Aug 09 02:19:38 dist-test-slave-w206 krb5kdc[18095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241978, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM
I20260809 02:19:38.817997 18182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:38.808183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:59217 (local address 127.11.93.190:34587)
0809 02:19:38.808250 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:38.808252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:38.808430 (+ 178us) server_negotiation.cc:407] Connection header received
0809 02:19:38.808907 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:38.808908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:38.808918 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:38.808978 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:38.809929 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:38.810727 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:38.812275 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:38.812472 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:38.812528 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:38.814913 (+ 2385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:38.814914 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:38.814914 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:38.814924 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:38.816424 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:38.816869 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:38.816870 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:38.816871 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:38.816946 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:38.817211 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:38.817212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:38.817213 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:38.817383 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:38.817460 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:38.817838 (+ 378us) server_negotiation.cc:299] Negotiation successful
0809 02:19:38.817929 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 02:19:38.818264 18344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:38.808123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.129:59217)
0809 02:19:38.808286 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:38.808329 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:38.808812 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:38.809030 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:38.809033 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:38.809605 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:38.809807 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:38.809812 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:38.810822 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:38.810823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:38.812180 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:38.812184 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:38.812560 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:38.812562 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:38.812709 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:38.813285 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:38.813293 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:38.814798 (+ 1505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:38.816529 (+ 1731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:38.816537 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:38.816540 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:38.816779 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:38.817020 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:38.817021 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:38.817021 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:38.817140 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:38.817481 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:38.817489 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:38.817668 (+ 179us) client_negotiation.cc:769] Sending connection context
0809 02:19:38.817812 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 02:19:38.817995 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":96,"threads_started":1}
I20260809 02:19:38.818780 18341 heartbeater.cc:347] Connected to a master server at 127.11.93.190:34587
I20260809 02:19:38.818873 18341 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:38.819105 18341 heartbeater.cc:511] Master 127.11.93.190:34587 requested a full tablet report, sending...
I20260809 02:19:38.819722 18140 ts_manager.cc:194] Registered new tserver with Master: c5f9d1717edc41209ab8ed56702e13ba (127.11.93.129:35047)
WARNING: no policy specified for oryx/127.11.93.130@KRBTEST.COM; defaulting to no policy
I20260809 02:19:38.820418 18140 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:59217
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.93.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.93.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.130.keytab.
Entry for principal oryx/127.11.93.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.130.keytab.
I20260809 02:19:38.838068 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:34587
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.130.keytab
--principal=oryx/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:38.920390 18347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:38.920600 18347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:38.920624 18347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:38.921751 18347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:38.921792 18347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:38.921818 18347 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:19:38.923210 18347 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.130.keytab
--principal=oryx/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:34587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:38.923413 18347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:38.923592 18347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:38.928592 18353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:38.928659 18355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:38.928622 18352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:38.928829 18347 server_base.cc:1034] running on GCE node
I20260809 02:19:38.929033 18347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:38.929234 18347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:38.930418 18347 hybrid_clock.cc:648] HybridClock initialized: now 1786241978930405 us; error 30 us; skew 500 ppm
Aug 09 02:19:38 dist-test-slave-w206 krb5kdc[18095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241978, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:38.933063 18347 init.cc:377] Logged in from keytab as oryx/127.11.93.130@KRBTEST.COM (short username oryx)
I20260809 02:19:38.933583 18347 webserver.cc:460] Webserver started at http://127.11.93.130:39761/ using document root <none> and password file <none>
I20260809 02:19:38.933777 18347 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:38.933818 18347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:38.933908 18347 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:38.935070 18347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9"
format_stamp: "Formatted at 2026-08-09 02:19:38 on dist-test-slave-w206"
server_key: "7bd2b5ae6a6a28ae6ba1a60ddbe6a87f"
server_key_iv: "5925cca1f007ab06ea1a29a20e491d69"
server_key_version: "encryptionkey@0"
I20260809 02:19:38.935396 18347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9"
format_stamp: "Formatted at 2026-08-09 02:19:38 on dist-test-slave-w206"
server_key: "7bd2b5ae6a6a28ae6ba1a60ddbe6a87f"
server_key_iv: "5925cca1f007ab06ea1a29a20e491d69"
server_key_version: "encryptionkey@0"
I20260809 02:19:38.936668 18347 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:19:38.937368 18362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:38.937572 18347 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:38.937656 18347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9"
format_stamp: "Formatted at 2026-08-09 02:19:38 on dist-test-slave-w206"
server_key: "7bd2b5ae6a6a28ae6ba1a60ddbe6a87f"
server_key_iv: "5925cca1f007ab06ea1a29a20e491d69"
server_key_version: "encryptionkey@0"
I20260809 02:19:38.937711 18347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:38.947842 18347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:38.950204 18347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:38.950415 18347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:38.950639 18347 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:38.950963 18347 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:38.951071 18347 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:38.951112 18347 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:38.951146 18347 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:38.956840 18347 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:42749
I20260809 02:19:38.956924 18481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:42749 every 8 connection(s)
I20260809 02:19:38.957257 18347 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:19:38.963320 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 18347
I20260809 02:19:38.963459 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:19:38.963671 11638 external_mini_cluster.cc:1428] Setting key 51f89f8440400284418b8c27f1cc8255
Aug 09 02:19:38 dist-test-slave-w206 krb5kdc[18095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241978, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM
I20260809 02:19:38.969340 18182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:38.958032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:43345 (local address 127.11.93.190:34587)
0809 02:19:38.958094 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:38.958096 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:38.958319 (+ 223us) server_negotiation.cc:407] Connection header received
0809 02:19:38.958864 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:38.958865 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:38.958885 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:38.958943 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:38.959941 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:38.960523 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:38.961649 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:38.961841 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:38.961938 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:38.966148 (+ 4210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:38.966150 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:38.966150 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:38.966157 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:38.967676 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:38.968252 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:38.968253 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:38.968253 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:38.968310 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:38.968655 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:38.968655 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:38.968656 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:38.968769 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:38.968825 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:38.969174 (+ 349us) server_negotiation.cc:299] Negotiation successful
0809 02:19:38.969274 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 02:19:38.969657 18484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:38.958002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.130:43345)
0809 02:19:38.958191 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:38.958228 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:38.958756 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:38.959030 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:38.959034 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:38.959620 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:38.959809 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:38.959814 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:38.960623 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:38.960624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:38.961556 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:38.961559 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:38.961951 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:38.961952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:38.962116 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:38.962650 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:38.962658 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:38.964404 (+ 1746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:38.967763 (+ 3359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:38.967770 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:38.967772 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:38.968140 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:38.968424 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:38.968425 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:38.968425 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:38.968581 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:38.968841 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:38.968848 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:38.969028 (+ 180us) client_negotiation.cc:769] Sending connection context
0809 02:19:38.969153 (+ 125us) client_negotiation.cc:240] Negotiation successful
0809 02:19:38.969347 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":94,"threads_started":1}
I20260809 02:19:38.970198 18482 heartbeater.cc:347] Connected to a master server at 127.11.93.190:34587
I20260809 02:19:38.970316 18482 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:38.970570 18482 heartbeater.cc:511] Master 127.11.93.190:34587 requested a full tablet report, sending...
I20260809 02:19:38.971033 18140 ts_manager.cc:194] Registered new tserver with Master: ddbaeb0e974f4cb98ce1bb675b60e5c9 (127.11.93.130:42749)
I20260809 02:19:38.971436 18140 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:43345
WARNING: no policy specified for oryx/127.11.93.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.93.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.93.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.131.keytab.
Entry for principal oryx/127.11.93.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.131.keytab.
I20260809 02:19:38.992250 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:34587
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.131.keytab
--principal=oryx/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:39.074497 18487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:39.074725 18487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:39.074764 18487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:39.075987 18487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:39.076056 18487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:39.076102 18487 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:19:39.077502 18487 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.131.keytab
--principal=oryx/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:34587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:39.077764 18487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:39.077998 18487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:39.082854 18494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:39.082932 18487 server_base.cc:1034] running on GCE node
W20260809 02:19:39.082870 18496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:39.082872 18493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:39.083320 18487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:39.083578 18487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:39.084759 18487 hybrid_clock.cc:648] HybridClock initialized: now 1786241979084723 us; error 50 us; skew 500 ppm
Aug 09 02:19:39 dist-test-slave-w206 krb5kdc[18095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241979, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:39.087813 18487 init.cc:377] Logged in from keytab as oryx/127.11.93.131@KRBTEST.COM (short username oryx)
I20260809 02:19:39.088297 18487 webserver.cc:460] Webserver started at http://127.11.93.131:42889/ using document root <none> and password file <none>
I20260809 02:19:39.088532 18487 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:39.088582 18487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:39.088740 18487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:39.089841 18487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf"
format_stamp: "Formatted at 2026-08-09 02:19:39 on dist-test-slave-w206"
server_key: "70ebc34ce1599ff3e5068faa8da2ac92"
server_key_iv: "943bd43f4850aafc43ca5a2b520bd44a"
server_key_version: "encryptionkey@0"
I20260809 02:19:39.090230 18487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf"
format_stamp: "Formatted at 2026-08-09 02:19:39 on dist-test-slave-w206"
server_key: "70ebc34ce1599ff3e5068faa8da2ac92"
server_key_iv: "943bd43f4850aafc43ca5a2b520bd44a"
server_key_version: "encryptionkey@0"
I20260809 02:19:39.091820 18487 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:19:39.092643 18503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:39.092850 18487 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:19:39.092938 18487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf"
format_stamp: "Formatted at 2026-08-09 02:19:39 on dist-test-slave-w206"
server_key: "70ebc34ce1599ff3e5068faa8da2ac92"
server_key_iv: "943bd43f4850aafc43ca5a2b520bd44a"
server_key_version: "encryptionkey@0"
I20260809 02:19:39.092986 18487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:39.108225 18487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:39.110481 18487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:39.110605 18487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:39.110808 18487 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:39.111189 18487 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:39.111227 18487 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:39.111250 18487 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:39.111263 18487 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:39.116935 18487 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:37587
I20260809 02:19:39.117023 18623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:37587 every 8 connection(s)
I20260809 02:19:39.117352 18487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:19:39.117667 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 18487
I20260809 02:19:39.117800 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:19:39.118002 11638 external_mini_cluster.cc:1428] Setting key 5ac1e966cb73b5d9cf2ca580a78886b8
Aug 09 02:19:39 dist-test-slave-w206 krb5kdc[18095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241979, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM
I20260809 02:19:39.127732 18182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.118114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:60125 (local address 127.11.93.190:34587)
0809 02:19:39.118167 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:39.118168 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:39.118621 (+ 453us) server_negotiation.cc:407] Connection header received
0809 02:19:39.119382 (+ 761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:39.119383 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:39.119395 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:39.119461 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:39.120525 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.121039 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.122082 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.122312 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.122387 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.124716 (+ 2329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:39.124718 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:39.124718 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:39.124727 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:39.126217 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.126691 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.126692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.126693 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.126754 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.127049 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.127051 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.127051 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.127179 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:39.127278 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:39.127555 (+ 277us) server_negotiation.cc:299] Negotiation successful
0809 02:19:39.127639 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 02:19:39.127933 18626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.118117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.131:60125)
0809 02:19:39.118453 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:39.118498 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:39.119254 (+ 756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:39.119542 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:39.119546 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:39.120167 (+ 621us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:39.120414 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.120420 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.121135 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.121136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.121989 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.121991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.122409 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.122410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.122523 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.123138 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:39.123147 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:39.124608 (+ 1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:39.126370 (+ 1762us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.126378 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.126380 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.126614 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.126834 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.126835 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.126835 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.126944 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.127270 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:39.127277 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:39.127418 (+ 141us) client_negotiation.cc:769] Sending connection context
0809 02:19:39.127520 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 02:19:39.127682 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":116,"threads_started":1}
I20260809 02:19:39.128417 18624 heartbeater.cc:347] Connected to a master server at 127.11.93.190:34587
I20260809 02:19:39.128521 18624 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:39.128701 18624 heartbeater.cc:511] Master 127.11.93.190:34587 requested a full tablet report, sending...
I20260809 02:19:39.129129 18140 ts_manager.cc:194] Registered new tserver with Master: 887dc57e6fcd4c4fa6ef7f208b093ddf (127.11.93.131:37587)
I20260809 02:19:39.129643 18140 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:60125
I20260809 02:19:39.129869 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.93.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.93.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.93.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.189.keytab.
Entry for principal oryx/127.11.93.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.189.keytab.
I20260809 02:19:39.158147 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.189:41047
--webserver_interface=127.11.93.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.189.keytab
--principal=oryx/127.11.93.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:34587,127.11.93.189:41047
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:39.241070 18629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:39.241323 18629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:39.241362 18629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:39.242484 18629 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:19:39.242553 18629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:39.242580 18629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:39.242610 18629 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:19:39.242633 18629 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:19:39.244151 18629 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:34587,127.11.93.189:41047
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.189.keytab
--principal=oryx/127.11.93.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.189:41047
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.93.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18629
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
W20260809 02:19:39.244310 18629 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.11.93.190:34587,127.11.93.189:41047'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260809 02:19:39.244459 18629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:39.244676 18629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:39.249584 18635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:39.249727 18629 server_base.cc:1034] running on GCE node
W20260809 02:19:39.249593 18639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:39.249615 18636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:39.250069 18629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:39.250386 18629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:39.251582 18629 hybrid_clock.cc:648] HybridClock initialized: now 1786241979251561 us; error 38 us; skew 500 ppm
Aug 09 02:19:39 dist-test-slave-w206 krb5kdc[18095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241979, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:39.254302 18629 init.cc:377] Logged in from keytab as oryx/127.11.93.189@KRBTEST.COM (short username oryx)
I20260809 02:19:39.254801 18629 webserver.cc:460] Webserver started at http://127.11.93.189:40667/ using document root <none> and password file <none>
I20260809 02:19:39.255091 18629 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:39.255159 18629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:39.255321 18629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:39.256372 18629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/data/instance:
uuid: "5ab97c7a07b64751b8dead417fea62a8"
format_stamp: "Formatted at 2026-08-09 02:19:39 on dist-test-slave-w206"
server_key: "424078beb99f233f2253c5053ab09965"
server_key_iv: "7b5e528cc4c9b5fe2c86fc5f88acd289"
server_key_version: "encryptionkey@0"
I20260809 02:19:39.256745 18629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/wal/instance:
uuid: "5ab97c7a07b64751b8dead417fea62a8"
format_stamp: "Formatted at 2026-08-09 02:19:39 on dist-test-slave-w206"
server_key: "424078beb99f233f2253c5053ab09965"
server_key_iv: "7b5e528cc4c9b5fe2c86fc5f88acd289"
server_key_version: "encryptionkey@0"
I20260809 02:19:39.258090 18629 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:19:39.258903 18647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:39.259092 18629 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:39.259191 18629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/wal
uuid: "5ab97c7a07b64751b8dead417fea62a8"
format_stamp: "Formatted at 2026-08-09 02:19:39 on dist-test-slave-w206"
server_key: "424078beb99f233f2253c5053ab09965"
server_key_iv: "7b5e528cc4c9b5fe2c86fc5f88acd289"
server_key_version: "encryptionkey@0"
I20260809 02:19:39.259274 18629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:39.272610 18629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:39.274926 18629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:39.275134 18629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:39.279073 18629 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.189:41047
I20260809 02:19:39.279130 18702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.189:41047 every 8 connection(s)
I20260809 02:19:39.279533 18629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/data/info.pb
I20260809 02:19:39.280541 18703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:39.282058 18703 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:19:39.283917 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 18629
Aug 09 02:19:39 dist-test-slave-w206 krb5kdc[18095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241979, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.189@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM
Aug 09 02:19:39 dist-test-slave-w206 krb5kdc[18095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.93.189@KRBTEST.COM
I20260809 02:19:39.292786 18182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.282759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45302 (local address 127.11.93.190:34587)
0809 02:19:39.282832 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:39.282835 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:39.283180 (+ 345us) server_negotiation.cc:407] Connection header received
0809 02:19:39.283662 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:39.283664 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:39.283673 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:39.283712 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:39.284567 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.285216 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.286599 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.286804 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.286881 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.289407 (+ 2526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:39.289409 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:39.289409 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:39.289416 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:39.291118 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.291677 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.291678 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.291678 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.291745 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.292014 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.292015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.292015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.292232 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:39.292312 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:39.292556 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 02:19:39.292660 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:19:39.292810 18705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.282744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.0.0.1:45302)
0809 02:19:39.283060 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:39.283099 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:39.283568 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:39.283774 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:39.283777 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:39.284124 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:39.284453 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.284461 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.285327 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.285328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.286490 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.286492 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.286904 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.286906 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.287100 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.287744 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:39.287754 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:39.289301 (+ 1547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:39.291223 (+ 1922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.291228 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.291230 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.291605 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.291813 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.291814 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.291814 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.291945 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.292308 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:39.292313 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:39.292424 (+ 111us) client_negotiation.cc:769] Sending connection context
0809 02:19:39.292509 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 02:19:39.292637 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":103,"threads_started":1}
I20260809 02:19:39.293428 18703 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:19:39.294387 18707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.284420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48958 (local address 127.11.93.189:41047)
0809 02:19:39.284595 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:39.284598 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:39.284631 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:19:39.284676 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:39.284678 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:39.284697 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:39.284792 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:39.285439 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.286652 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.287648 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.288152 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.288232 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.291030 (+ 2798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:39.291038 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:39.291039 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:39.291046 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:39.292970 (+ 1924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.293433 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.293435 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.293435 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.293503 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.293763 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.293765 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.293765 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.293954 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:39.294090 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:39.294207 (+ 117us) server_negotiation.cc:299] Negotiation successful
0809 02:19:39.294267 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":106,"threads_started":1}
Aug 09 02:19:39 dist-test-slave-w206 krb5kdc[18095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241979, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.189@KRBTEST.COM for oryx/127.11.93.189@KRBTEST.COM
I20260809 02:19:39.300432 18705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.293731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:41047 (local address 127.0.0.1:48960)
0809 02:19:39.293761 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:39.293771 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:39.293808 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:39.294027 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:39.294028 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:39.294183 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:39.294248 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.294250 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.295055 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.295055 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.295627 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.295629 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.296011 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.296012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.296078 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.296435 (+ 357us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:39.296439 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:39.297554 (+ 1115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:39.299465 (+ 1911us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.299466 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.299467 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.299628 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.299822 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.299822 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.299823 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.299894 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.300133 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:39.300134 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:39.300171 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 02:19:39.300235 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 02:19:39.300329 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15}
I20260809 02:19:39.300530 18708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.293764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48960 (local address 127.11.93.189:41047)
0809 02:19:39.293919 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:39.293921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:39.293928 (+ 7us) server_negotiation.cc:407] Connection header received
0809 02:19:39.293945 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:39.293946 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:39.293957 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:39.294022 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:39.294321 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.294942 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.295717 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.295933 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.296012 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.297640 (+ 1628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:39.297641 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:39.297641 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:39.297648 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:39.299388 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.299706 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.299707 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.299708 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.299761 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.299970 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.299971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.299971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.300072 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:39.300143 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:39.300260 (+ 117us) server_negotiation.cc:299] Negotiation successful
0809 02:19:39.300387 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":134,"thread_start_us":90,"threads_started":1}
I20260809 02:19:39.301770 18703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8: Bootstrap starting.
I20260809 02:19:39.302353 18703 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:39.302587 18703 log.cc:824] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:39.303337 18703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8: No bootstrap required, opened a new log
I20260809 02:19:39.304661 18703 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } }
I20260809 02:19:39.304776 18703 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:39.304798 18703 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ab97c7a07b64751b8dead417fea62a8, State: Initialized, Role: FOLLOWER
I20260809 02:19:39.304899 18703 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } }
I20260809 02:19:39.305143 18703 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:19:39.305135 18711 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } } }
I20260809 02:19:39.305320 18711 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 02:19:39.306793 18723 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:19:39.306854 18723 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:19:39.308482 18629 master_runner.cc:428] Detected that this master 5ab97c7a07b64751b8dead417fea62a8 is joining an existing cluster
I20260809 02:19:39.308563 18629 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.93.189:41047
I20260809 02:19:39.316790 18708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.309828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48976 (local address 127.11.93.189:41047)
0809 02:19:39.309861 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:39.309863 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:39.309870 (+ 7us) server_negotiation.cc:407] Connection header received
0809 02:19:39.309890 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:39.309891 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:39.309899 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:39.309955 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:39.310322 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.311071 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.312105 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.312297 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.312373 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.313403 (+ 1030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:39.313404 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:39.313405 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:39.313412 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:39.315502 (+ 2090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.316062 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.316064 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.316065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.316116 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.316287 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.316287 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.316288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.316405 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:39.316445 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:39.316624 (+ 179us) server_negotiation.cc:299] Negotiation successful
0809 02:19:39.316699 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 02:19:39.317188 18730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.309599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:41047 (local address 127.0.0.1:48976)
0809 02:19:39.309708 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:39.309719 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:39.309793 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:39.309998 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:39.309999 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:39.310206 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:39.310261 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.310263 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.311145 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.311146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.312026 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.312028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.312385 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.312386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.312447 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.312890 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:39.312895 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:39.313311 (+ 416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:39.315591 (+ 2280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.315591 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.315592 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.315963 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.316177 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.316178 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.316178 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.316227 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.316483 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:39.316484 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:39.316518 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 02:19:39.317003 (+ 485us) client_negotiation.cc:240] Negotiation successful
0809 02:19:39.317092 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":72,"threads_started":1}
I20260809 02:19:39.320447 18182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.309604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45318 (local address 127.11.93.190:34587)
0809 02:19:39.309771 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:39.309773 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:39.309783 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:19:39.309878 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:39.309880 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:39.309891 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:39.309940 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:39.310271 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.311072 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.313086 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.313397 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.313463 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.316084 (+ 2621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:39.316086 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:39.316086 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:39.316095 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:39.318139 (+ 2044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.318759 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.318760 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.318761 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.318824 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.319815 (+ 991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.319816 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.319816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.319987 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:39.320061 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:39.320281 (+ 220us) server_negotiation.cc:299] Negotiation successful
0809 02:19:39.320355 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143}
I20260809 02:19:39.320456 18729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.309542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.0.0.1:45318)
0809 02:19:39.309705 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:39.309716 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:39.309780 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:39.309942 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:39.309943 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:39.310118 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:39.310179 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.310180 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.312130 (+ 1950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.312131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.312995 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.312998 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.313463 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.313464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.313538 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.314076 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:39.314081 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:39.315975 (+ 1894us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:39.318223 (+ 2248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.318224 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.318224 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.318558 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.318890 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.318891 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.318892 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.318996 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.320090 (+ 1094us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:39.320091 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:39.320156 (+ 65us) client_negotiation.cc:769] Sending connection context
0809 02:19:39.320252 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 02:19:39.320355 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":85,"threads_started":1}
Aug 09 02:19:39 dist-test-slave-w206 krb5kdc[18095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241978, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.190@KRBTEST.COM for oryx/127.11.93.189@KRBTEST.COM
I20260809 02:19:39.331369 18708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.323064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48978 (local address 127.11.93.189:41047)
0809 02:19:39.323096 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:39.323098 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:39.323192 (+ 94us) server_negotiation.cc:407] Connection header received
0809 02:19:39.323286 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:39.323287 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:39.323296 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:39.323357 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:39.323883 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.324601 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.325698 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.325990 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.326057 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.328363 (+ 2306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:39.328364 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:39.328365 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:39.328371 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:39.329998 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.330479 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.330481 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.330481 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.330537 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.330731 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.330732 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.330732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.330849 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:39.330892 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:39.331198 (+ 306us) server_negotiation.cc:299] Negotiation successful
0809 02:19:39.331278 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 02:19:39.331955 18731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.322841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:41047 (local address 127.0.0.1:48978)
0809 02:19:39.323063 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:39.323119 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:39.323205 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:39.323360 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:39.323363 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:39.323733 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:39.323803 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.323805 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.324692 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.324693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.325625 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.325627 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.326110 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.326111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.326195 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.326656 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:39.326661 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:39.328260 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:39.330091 (+ 1831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.330099 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.330101 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.330390 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.330607 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.330608 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.330608 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.330664 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.330940 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:39.330947 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:39.331056 (+ 109us) client_negotiation.cc:769] Sending connection context
0809 02:19:39.331703 (+ 647us) client_negotiation.cc:240] Negotiation successful
0809 02:19:39.331838 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":66,"threads_started":1}
I20260809 02:19:39.332819 18140 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.93.189:41047: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8"
member_type: NON_VOTER
last_known_addr {
host: "127.11.93.189"
port: 41047
}
attrs {
promote: true
}
}
dest_uuid: "112dec87977444b9a74941e09be89dea"
cas_config_opid_index: -1
I20260809 02:19:39.333177 18140 consensus_queue.cc:237] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: NON_VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: true } }
I20260809 02:19:39.333688 18734 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 5ab97c7a07b64751b8dead417fea62a8 (127.11.93.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: NON_VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: true } } }
I20260809 02:19:39.333976 18676 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:39.334792 18734 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.93.189:41047
I20260809 02:19:39.335019 18676 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 1 FOLLOWER]: Refusing update from remote peer 112dec87977444b9a74941e09be89dea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260809 02:19:39.335132 18629 master.cc:537] Master@127.11.93.189:41047 shutting down...
I20260809 02:19:39.335105 18732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "112dec87977444b9a74941e09be89dea" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: NON_VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: true } } }
I20260809 02:19:39.335180 18732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:39.335410 18734 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: NON_VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 02:19:39.336122 18125 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260809 02:19:39.336776 18125 consensus_peers.cc:487] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea -> Peer 5ab97c7a07b64751b8dead417fea62a8 (127.11.93.189:41047): Couldn't send request to peer 5ab97c7a07b64751b8dead417fea62a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 02:19:39.338296 18629 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:39.338392 18629 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:39.338442 18629 tablet_replica.cc:330] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8: stopping tablet replica
I20260809 02:19:39.350965 18629 master.cc:552] Master@127.11.93.189:41047 shutdown complete.
I20260809 02:19:39.351068 18629 master_runner.cc:305] Clearing existing system tablet
I20260809 02:19:39.351194 18629 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:39.351264 18629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:39.351890 18629 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:39.352383 18738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:39.352517 18629 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:39.352579 18629 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:39.352609 18629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/wal
uuid: "5ab97c7a07b64751b8dead417fea62a8"
format_stamp: "Formatted at 2026-08-09 02:19:39 on dist-test-slave-w206"
server_key: "424078beb99f233f2253c5053ab09965"
server_key_iv: "7b5e528cc4c9b5fe2c86fc5f88acd289"
server_key_version: "encryptionkey@0"
I20260809 02:19:39.353302 18629 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:39.354791 18629 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 02:19:39.354887 18629 log.cc:1196] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260809 02:19:39.355197 18629 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8: Deleting consensus metadata
I20260809 02:19:39.355336 18629 master_runner.cc:315] Copying system tablet from 127.11.93.190:34587
I20260809 02:19:39.355918 18629 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8: tablet copy: Beginning tablet copy session from remote peer at address 127.11.93.190:34587
I20260809 02:19:39.362304 18182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.356266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45324 (local address 127.11.93.190:34587)
0809 02:19:39.356311 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:39.356313 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:39.356385 (+ 72us) server_negotiation.cc:407] Connection header received
0809 02:19:39.356462 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:39.356463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:39.356471 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:39.356514 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:39.356884 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.357350 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.358377 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.358623 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.358681 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.359701 (+ 1020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:39.359702 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:39.359703 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:39.359708 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:39.361177 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.361579 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.361579 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.361580 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.361628 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.361832 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.361832 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.361833 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.361928 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:39.361976 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:39.362147 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 02:19:39.362213 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 02:19:39.362342 18745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.356186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.0.0.1:45324)
0809 02:19:39.356317 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:39.356328 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:39.356403 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:39.356529 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:39.356530 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:39.356735 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:39.356811 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.356813 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.357423 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.357424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.358298 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.358300 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.358684 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.358685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.358758 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.359222 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:39.359227 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:39.359622 (+ 395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:39.361255 (+ 1633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.361256 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.361257 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.361490 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.361701 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.361701 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.361702 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.361771 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.361987 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:39.361988 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:39.362035 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 02:19:39.362111 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 02:19:39.362214 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":80,"threads_started":1}
I20260809 02:19:39.362643 18162 tablet_copy_service.cc:140] P 112dec87977444b9a74941e09be89dea: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 5ab97c7a07b64751b8dead417fea62a8 ({username='oryx', principal='oryx/127.11.93.189@KRBTEST.COM'} at 127.0.0.1:45324)
I20260809 02:19:39.362743 18162 tablet_copy_service.cc:161] P 112dec87977444b9a74941e09be89dea: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 5ab97c7a07b64751b8dead417fea62a8 at {username='oryx', principal='oryx/127.11.93.189@KRBTEST.COM'} at 127.0.0.1:45324: session id = 5ab97c7a07b64751b8dead417fea62a8-00000000000000000000000000000000
I20260809 02:19:39.363601 18162 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 02:19:39.364219 18629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 02:19:39.365159 18629 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8: tablet copy: Starting download of 0 data blocks...
I20260809 02:19:39.365329 18629 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8: tablet copy: Starting download of 1 WAL segments...
I20260809 02:19:39.366235 18629 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 02:19:39.367072 18162 tablet_copy_service.cc:342] P 112dec87977444b9a74941e09be89dea: Request end of tablet copy session 5ab97c7a07b64751b8dead417fea62a8-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.93.189@KRBTEST.COM'} at 127.0.0.1:45324
I20260809 02:19:39.367141 18162 tablet_copy_service.cc:433] P 112dec87977444b9a74941e09be89dea: ending tablet copy session 5ab97c7a07b64751b8dead417fea62a8-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 5ab97c7a07b64751b8dead417fea62a8
I20260809 02:19:39.369643 18629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:39.370718 18747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:39.370798 18748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:39.371907 18751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:39.371954 18629 server_base.cc:1034] running on GCE node
I20260809 02:19:39.372144 18629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:39.372331 18629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:39.373458 18629 hybrid_clock.cc:648] HybridClock initialized: now 1786241979373457 us; error 30 us; skew 500 ppm
Aug 09 02:19:39 dist-test-slave-w206 krb5kdc[18095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241979, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:39.374733 18629 init.cc:377] Logged in from keytab as oryx/127.11.93.189@KRBTEST.COM (short username oryx)
I20260809 02:19:39.375065 18629 webserver.cc:460] Webserver started at http://127.11.93.189:36293/ using document root <none> and password file <none>
I20260809 02:19:39.375200 18629 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:39.375285 18629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:39.375895 18629 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:39.376420 18759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:39.376534 18629 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:39.376579 18629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/wal
uuid: "5ab97c7a07b64751b8dead417fea62a8"
format_stamp: "Formatted at 2026-08-09 02:19:39 on dist-test-slave-w206"
server_key: "424078beb99f233f2253c5053ab09965"
server_key_iv: "7b5e528cc4c9b5fe2c86fc5f88acd289"
server_key_version: "encryptionkey@0"
I20260809 02:19:39.376636 18629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:39.391641 18629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:39.393281 18629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:39.396474 18629 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.189:41047
I20260809 02:19:39.396744 18812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.189:41047 every 8 connection(s)
I20260809 02:19:39.396886 18629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-1/data/info.pb
I20260809 02:19:39.397864 18813 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:19:39.398432 18813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8: Bootstrap starting.
I20260809 02:19:39.401584 18813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:19:39.401815 18813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8: Bootstrap complete.
I20260809 02:19:39.402042 18813 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: NON_VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: true } }
I20260809 02:19:39.402138 18813 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5ab97c7a07b64751b8dead417fea62a8, State: Initialized, Role: LEARNER
I20260809 02:19:39.402176 18813 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: NON_VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: true } }
I20260809 02:19:39.402341 18813 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:19:39.402356 18816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: NON_VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: true } } }
I20260809 02:19:39.402484 18816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [sys.catalog]: This master's current role is: LEARNER
I20260809 02:19:39.403950 18827 catalog_manager.cc:1259] Loaded cluster ID: 89ee773d252f4feeaa259289ca4934c0
I20260809 02:19:39.404027 18827 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8: loading cluster ID for follower catalog manager: success
I20260809 02:19:39.404994 18827 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8: acquiring CA information for follower catalog manager: success
I20260809 02:19:39.405256 18827 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:19:39.452966 18828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.446442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49010 (local address 127.11.93.189:41047)
0809 02:19:39.446624 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:39.446626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:39.446633 (+ 7us) server_negotiation.cc:407] Connection header received
0809 02:19:39.446656 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:39.446657 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:39.446665 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:39.446765 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:39.447357 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.448013 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.448773 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.448968 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.449054 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.450281 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:39.450282 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:39.450282 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:39.450289 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:39.451796 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.452175 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.452176 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.452177 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.452242 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.452440 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.452441 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.452441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.452554 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:39.452655 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:39.452761 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 02:19:39.452854 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":68,"threads_started":1}
WARNING: no policy specified for oryx/127.11.93.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.93.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.93.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.188.keytab.
Entry for principal oryx/127.11.93.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.188.keytab.
I20260809 02:19:39.482802 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.188:34943
--webserver_interface=127.11.93.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.188.keytab
--principal=oryx/127.11.93.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:34587,127.11.93.189:41047,127.11.93.188:34943
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:39.566543 18831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:39.566751 18831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:39.566774 18831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:39.568055 18831 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:19:39.568099 18831 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:39.568113 18831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:39.568157 18831 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:19:39.568181 18831 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:19:39.569650 18831 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:34587,127.11.93.189:41047,127.11.93.188:34943
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.188.keytab
--principal=oryx/127.11.93.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.188:34943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.93.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18831
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:39.569917 18831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:39.570142 18831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:39.574900 18837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:39.574915 18839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:39.574959 18836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:39.575117 18831 server_base.cc:1034] running on GCE node
I20260809 02:19:39.575428 18831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:39.575711 18831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:39.576905 18831 hybrid_clock.cc:648] HybridClock initialized: now 1786241979576889 us; error 32 us; skew 500 ppm
Aug 09 02:19:39 dist-test-slave-w206 krb5kdc[18095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241979, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:39.579504 18831 init.cc:377] Logged in from keytab as oryx/127.11.93.188@KRBTEST.COM (short username oryx)
I20260809 02:19:39.579931 18831 webserver.cc:460] Webserver started at http://127.11.93.188:38695/ using document root <none> and password file <none>
I20260809 02:19:39.580128 18831 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:39.580169 18831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:39.580281 18831 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:39.581272 18831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/data/instance:
uuid: "bc09e44584e24b83bbbe6f6998fae662"
format_stamp: "Formatted at 2026-08-09 02:19:39 on dist-test-slave-w206"
server_key: "c2ece685b6d2f01717ef6992f28fea17"
server_key_iv: "8328f39a677e76692be02c93bb35cd51"
server_key_version: "encryptionkey@0"
I20260809 02:19:39.581566 18831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/wal/instance:
uuid: "bc09e44584e24b83bbbe6f6998fae662"
format_stamp: "Formatted at 2026-08-09 02:19:39 on dist-test-slave-w206"
server_key: "c2ece685b6d2f01717ef6992f28fea17"
server_key_iv: "8328f39a677e76692be02c93bb35cd51"
server_key_version: "encryptionkey@0"
I20260809 02:19:39.582836 18831 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:19:39.583666 18847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:39.583819 18831 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:39.583902 18831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/wal
uuid: "bc09e44584e24b83bbbe6f6998fae662"
format_stamp: "Formatted at 2026-08-09 02:19:39 on dist-test-slave-w206"
server_key: "c2ece685b6d2f01717ef6992f28fea17"
server_key_iv: "8328f39a677e76692be02c93bb35cd51"
server_key_version: "encryptionkey@0"
I20260809 02:19:39.583956 18831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:39.593246 18831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:39.595356 18831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:39.595474 18831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:39.599531 18831 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.188:34943
I20260809 02:19:39.599587 18903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.188:34943 every 8 connection(s)
I20260809 02:19:39.599910 18831 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/data/info.pb
I20260809 02:19:39.601117 18904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:39.603101 18904 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:19:39.608050 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 18831
Aug 09 02:19:39 dist-test-slave-w206 krb5kdc[18095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241979, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.188@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM
I20260809 02:19:39.612876 18182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.603985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45340 (local address 127.11.93.190:34587)
0809 02:19:39.604053 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:39.604056 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:39.604256 (+ 200us) server_negotiation.cc:407] Connection header received
0809 02:19:39.604758 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:39.604759 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:39.604768 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:39.604817 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:39.605447 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.605931 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.607093 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.607274 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.607327 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.609893 (+ 2566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:39.609895 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:39.609895 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:39.609901 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:39.611348 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.611925 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.611926 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.611926 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.611983 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.612259 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.612259 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.612260 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.612359 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:39.612413 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:39.612748 (+ 335us) server_negotiation.cc:299] Negotiation successful
0809 02:19:39.612812 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 02:19:39.613150 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.603915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.0.0.1:45340)
0809 02:19:39.604113 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:39.604167 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:39.604673 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:39.604882 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:39.604886 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:39.605171 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:39.605374 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.605379 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.606018 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.606019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.606954 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.606957 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.607380 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.607381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.607497 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.608021 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:39.608028 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:39.609804 (+ 1776us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:39.611513 (+ 1709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.611517 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.611520 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.611830 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.612044 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.612045 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.612045 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.612191 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.612423 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:39.612431 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:39.612604 (+ 173us) client_negotiation.cc:769] Sending connection context
0809 02:19:39.612734 (+ 130us) client_negotiation.cc:240] Negotiation successful
0809 02:19:39.612899 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":113,"threads_started":1}
Aug 09 02:19:39 dist-test-slave-w206 krb5kdc[18095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241978, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.93.188@KRBTEST.COM
I20260809 02:19:39.613750 18904 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:19:39.617115 18907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.608626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49726 (local address 127.11.93.188:34943)
0809 02:19:39.608769 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:39.608772 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:39.608787 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:19:39.608805 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:39.608806 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:39.608822 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:39.608918 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:39.609492 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.610299 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.611075 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.611352 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.611433 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.614228 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:39.614236 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:39.614236 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:39.614243 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:39.615947 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.616316 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.616319 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.616320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.616384 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.616578 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.616579 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.616579 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.616718 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:39.616869 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:39.616928 (+ 59us) server_negotiation.cc:299] Negotiation successful
0809 02:19:39.617006 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":84,"threads_started":1}
Aug 09 02:19:39 dist-test-slave-w206 krb5kdc[18095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241979, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.188@KRBTEST.COM for oryx/127.11.93.189@KRBTEST.COM
I20260809 02:19:39.620240 18828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.614077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49024 (local address 127.11.93.189:41047)
0809 02:19:39.614145 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:39.614147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:39.614157 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:19:39.614212 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:39.614213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:39.614227 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:39.614290 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:39.614549 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.615112 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.615778 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.616026 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.616101 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.617834 (+ 1733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:39.617835 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:39.617835 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:39.617843 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:39.619249 (+ 1406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.619607 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.619608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.619608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.619656 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.619825 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.619825 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.619825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.619938 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:39.619988 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:39.620114 (+ 126us) server_negotiation.cc:299] Negotiation successful
0809 02:19:39.620179 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 02:19:39.620275 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.614001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:41047 (local address 127.0.0.1:49024)
0809 02:19:39.614120 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:39.614129 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:39.614163 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:39.614291 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:39.614292 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:39.614431 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:39.614472 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.614473 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.615226 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.615227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.615697 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.615698 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.616094 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.616095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.616152 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.616521 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:39.616525 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:39.617735 (+ 1210us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:39.619353 (+ 1618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.619354 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.619354 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.619539 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.619712 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.619713 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.619713 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.619774 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.619992 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:39.619992 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:39.620028 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 02:19:39.620097 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 02:19:39.620171 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260809 02:19:39.620784 18904 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:19:39 dist-test-slave-w206 krb5kdc[18095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241979, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.188@KRBTEST.COM for oryx/127.11.93.188@KRBTEST.COM
I20260809 02:19:39.626829 18906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.621132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:34943 (local address 127.0.0.1:49734)
0809 02:19:39.621180 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:39.621193 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:39.621234 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:39.621354 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:39.621354 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:39.621470 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:39.621499 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.621500 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.622058 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.622058 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.622551 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.622552 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.622855 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.622856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.622894 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.623344 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:39.623350 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:39.624615 (+ 1265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:39.626021 (+ 1406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.626021 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.626022 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.626185 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.626354 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.626354 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.626355 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.626407 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.626607 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:39.626607 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:39.626641 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 02:19:39.626692 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 02:19:39.626766 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 02:19:39.626894 18907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.621193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49734 (local address 127.11.93.188:34943)
0809 02:19:39.621227 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:39.621229 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:39.621237 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:19:39.621298 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:39.621299 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:39.621306 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:39.621350 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:39.621551 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.621995 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.622614 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.622795 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.622844 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.624694 (+ 1850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:39.624695 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:39.624696 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:39.624702 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:39.625944 (+ 1242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.626256 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.626256 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.626257 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.626303 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.626469 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.626470 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.626470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.626560 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:39.626604 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:39.626704 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 02:19:39.626808 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":16}
I20260809 02:19:39.628319 18904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662: Bootstrap starting.
I20260809 02:19:39.629191 18904 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:39.629446 18904 log.cc:824] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:39.630122 18904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662: No bootstrap required, opened a new log
I20260809 02:19:39.632051 18904 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } }
I20260809 02:19:39.632231 18904 raft_consensus.cc:374] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:39.632264 18904 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc09e44584e24b83bbbe6f6998fae662, State: Initialized, Role: FOLLOWER
I20260809 02:19:39.632407 18904 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } }
I20260809 02:19:39.632669 18909 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } } }
I20260809 02:19:39.632717 18904 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:19:39.632781 18909 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 02:19:39.634577 18920 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:19:39.634640 18920 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:19:39.636931 18831 master_runner.cc:428] Detected that this master bc09e44584e24b83bbbe6f6998fae662 is joining an existing cluster
I20260809 02:19:39.636981 18831 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.93.188:34943
I20260809 02:19:39.645061 18182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.637992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45350 (local address 127.11.93.190:34587)
0809 02:19:39.638039 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:39.638042 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:39.638213 (+ 171us) server_negotiation.cc:407] Connection header received
0809 02:19:39.638288 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:39.638289 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:39.638299 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:39.638355 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:39.638786 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.639635 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.640796 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.641093 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.641131 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.642232 (+ 1101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:39.642233 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:39.642234 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:39.642240 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:39.643759 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.644155 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.644157 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.644157 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.644222 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.644471 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.644472 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.644472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.644604 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:39.644679 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:39.644850 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 02:19:39.644934 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 02:19:39.645479 18927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.637966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.0.0.1:45350)
0809 02:19:39.638141 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:39.638151 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:39.638227 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:39.638359 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:39.638359 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:39.638611 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:39.638692 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.638695 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.639723 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.639723 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.640707 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.640709 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.641217 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.641218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.641289 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.641792 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:39.641796 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:39.642131 (+ 335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:39.643849 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.643850 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.643851 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.644086 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.644297 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.644299 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.644299 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.644371 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.644670 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:39.644670 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:39.644717 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 02:19:39.645171 (+ 454us) client_negotiation.cc:240] Negotiation successful
0809 02:19:39.645276 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":87,"threads_started":1}
Aug 09 02:19:39 dist-test-slave-w206 krb5kdc[18095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241978, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.190@KRBTEST.COM for oryx/127.11.93.188@KRBTEST.COM
I20260809 02:19:39.659998 18928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.638450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:34943 (local address 127.0.0.1:49740)
0809 02:19:39.638665 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:39.638679 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:39.638783 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:39.639091 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:39.639091 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:39.639337 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:39.639407 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.639409 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.640371 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.640372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.641301 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.641304 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.642213 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.642214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.642278 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.643063 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:39.643068 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:39.644129 (+ 1061us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:39.645954 (+ 1825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.645956 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.645956 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.646211 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.646465 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.646466 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.646466 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.646528 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.659325 (+ 12797us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:39.659327 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:39.659402 (+ 75us) client_negotiation.cc:769] Sending connection context
0809 02:19:39.659688 (+ 286us) client_negotiation.cc:240] Negotiation successful
0809 02:19:39.659784 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":121,"threads_started":1}
I20260809 02:19:39.660017 18907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.638470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49740 (local address 127.11.93.188:34943)
0809 02:19:39.638503 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:39.638504 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:39.638751 (+ 247us) server_negotiation.cc:407] Connection header received
0809 02:19:39.638876 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:39.638877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:39.638888 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:39.638947 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:39.639510 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.640263 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.641771 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.642069 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.642124 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.644223 (+ 2099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:39.644224 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:39.644224 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:39.644231 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:39.645865 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.646321 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.646322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.646323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.646381 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.646745 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.646746 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.646747 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.659210 (+ 12463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:39.659292 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:39.659557 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 02:19:39.659666 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 02:19:39.663065 18930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.647886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49750 (local address 127.11.93.188:34943)
0809 02:19:39.648052 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:39.648053 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:39.648061 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:19:39.648098 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:39.648099 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:39.648107 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:39.648163 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:39.648518 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.649241 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.650292 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.650510 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.650555 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.652663 (+ 2108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:39.652664 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:39.652665 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:39.652672 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:39.661732 (+ 9060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.662090 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.662092 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.662092 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.662158 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.662367 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.662367 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.662368 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.662528 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:39.662601 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:39.662820 (+ 219us) server_negotiation.cc:299] Negotiation successful
0809 02:19:39.662908 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":121,"threads_started":1}
I20260809 02:19:39.663066 18731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.647840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:34943 (local address 127.0.0.1:49750)
0809 02:19:39.647899 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:39.647910 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:39.647952 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:39.648195 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:39.648196 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:39.648389 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:39.648438 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.648440 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.649331 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.649333 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.650198 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.650201 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.650581 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.650582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.650670 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.651095 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:39.651101 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:39.652579 (+ 1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:39.661819 (+ 9240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.661820 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.661821 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.662005 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.662233 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.662233 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.662234 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.662300 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.662614 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:39.662616 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:39.662684 (+ 68us) client_negotiation.cc:769] Sending connection context
0809 02:19:39.662785 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 02:19:39.662920 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 02:19:39.663564 18828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.638030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49036 (local address 127.11.93.189:41047)
0809 02:19:39.638085 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:39.638087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:39.638691 (+ 604us) server_negotiation.cc:407] Connection header received
0809 02:19:39.638788 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:39.638788 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:39.638798 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:39.638828 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:39.639271 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.639978 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.640961 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.641248 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.641287 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.660323 (+ 19036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:39.660324 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:39.660325 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:39.660333 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:39.662346 (+ 2013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.662733 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.662734 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.662735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.662795 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.663058 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.663059 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.663060 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.663201 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:39.663267 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:39.663400 (+ 133us) server_negotiation.cc:299] Negotiation successful
0809 02:19:39.663477 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 02:19:39.663576 18929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.638162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:41047 (local address 127.0.0.1:49036)
0809 02:19:39.638625 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:39.638635 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:39.638715 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:39.638889 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:39.638889 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:39.639109 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:39.639182 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.639184 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.640067 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.640068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.640883 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.640885 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.641360 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.641361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.641439 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.659489 (+ 18050us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:39.659495 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:39.660216 (+ 721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:39.662445 (+ 2229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.662446 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.662446 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.662653 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.662905 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.662905 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.662905 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.662964 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.663259 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:39.663259 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:39.663300 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 02:19:39.663355 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 02:19:39.663471 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":91,"threads_started":1}
I20260809 02:19:39.664338 18140 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.93.188:34943: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662"
member_type: NON_VOTER
last_known_addr {
host: "127.11.93.188"
port: 34943
}
attrs {
promote: true
}
}
dest_uuid: "112dec87977444b9a74941e09be89dea"
cas_config_opid_index: 5
I20260809 02:19:39.664592 18140 consensus_queue.cc:237] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: NON_VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: true } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: NON_VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: true } }
I20260809 02:19:39.665169 18931 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER bc09e44584e24b83bbbe6f6998fae662 (127.11.93.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: NON_VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: true } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: NON_VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: true } } }
I20260809 02:19:39.665588 18874 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:39.666328 18931 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.93.188:34943
I20260809 02:19:39.666551 18831 master.cc:537] Master@127.11.93.188:34943 shutting down...
I20260809 02:19:39.667047 18874 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 1 FOLLOWER]: Refusing update from remote peer 112dec87977444b9a74941e09be89dea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 02:19:39.667495 18734 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: NON_VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:39.668093 18732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "112dec87977444b9a74941e09be89dea" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: NON_VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: true } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: NON_VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: true } } }
I20260809 02:19:39.668185 18732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [sys.catalog]: This master's current role is: LEADER
W20260809 02:19:39.669198 18125 consensus_peers.cc:487] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea -> Peer bc09e44584e24b83bbbe6f6998fae662 (127.11.93.188:34943): Couldn't send request to peer bc09e44584e24b83bbbe6f6998fae662. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 02:19:39.671082 18731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.665313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:41047 (local address 127.0.0.1:49046)
0809 02:19:39.667350 (+ 2037us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:39.667362 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:39.667442 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:39.667666 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:39.667667 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:39.667668 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:39.667706 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.667707 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.668568 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.668569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.669803 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.669806 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.670775 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.670776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.670848 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.670870 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 02:19:39.670939 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 02:19:39.671006 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2022}
I20260809 02:19:39.671100 18828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.665396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49046 (local address 127.11.93.189:41047)
0809 02:19:39.665440 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:39.665442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:39.667414 (+ 1972us) server_negotiation.cc:407] Connection header received
0809 02:19:39.667559 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:39.667560 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:39.667582 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:39.667648 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:39.667767 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.668479 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.669917 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.670585 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.670627 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.670712 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:39.670951 (+ 239us) server_negotiation.cc:299] Negotiation successful
0809 02:19:39.671023 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 02:19:39.671340 18787 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 1 LEARNER]: Refusing update from remote peer 112dec87977444b9a74941e09be89dea: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 02:19:39.671574 18732 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: NON_VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260809 02:19:39.672159 18831 raft_consensus.cc:2229] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:39.672251 18831 raft_consensus.cc:2258] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:39.672307 18831 tablet_replica.cc:330] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662: stopping tablet replica
I20260809 02:19:39.672232 18787 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER bc09e44584e24b83bbbe6f6998fae662 (127.11.93.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: NON_VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: true } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: NON_VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: true } } }
I20260809 02:19:39.673480 18933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "112dec87977444b9a74941e09be89dea" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: NON_VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: true } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: NON_VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: true } } }
I20260809 02:19:39.673591 18933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [sys.catalog]: This master's current role is: LEARNER
I20260809 02:19:39.673856 18816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 112dec87977444b9a74941e09be89dea. Latest consensus state: current_term: 1 leader_uuid: "112dec87977444b9a74941e09be89dea" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: NON_VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: true } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: NON_VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: true } } }
I20260809 02:19:39.673956 18816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [sys.catalog]: This master's current role is: LEARNER
I20260809 02:19:39.674831 18732 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea: attempting to promote NON_VOTER 5ab97c7a07b64751b8dead417fea62a8 to VOTER
I20260809 02:19:39.675078 18732 consensus_queue.cc:237] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: NON_VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: true } }
I20260809 02:19:39.675683 18731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.675555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:34943 (local address 127.0.0.1:49752)
0809 02:19:39.675592 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:39.675652 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:34943: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260809 02:19:39.675763 18787 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 1 LEARNER]: Refusing update from remote peer 112dec87977444b9a74941e09be89dea: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 02:19:39.676014 18931 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260809 02:19:39.676090 18731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.675934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:34943 (local address 127.0.0.1:49758)
0809 02:19:39.675989 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:39.676014 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:34943: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 02:19:39.676182 18125 consensus_peers.cc:487] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea -> Peer bc09e44584e24b83bbbe6f6998fae662 (127.11.93.188:34943): Couldn't send request to peer bc09e44584e24b83bbbe6f6998fae662. Status: Network error: Client connection negotiation failed: client connection to 127.11.93.188:34943: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 02:19:39.676782 18734 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 5ab97c7a07b64751b8dead417fea62a8 (127.11.93.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: NON_VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: true } } }
I20260809 02:19:39.676981 18787 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 5ab97c7a07b64751b8dead417fea62a8 (127.11.93.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: NON_VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: true } } }
I20260809 02:19:39.677548 18734 sys_catalog.cc:455] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "112dec87977444b9a74941e09be89dea" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: NON_VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: true } } }
I20260809 02:19:39.677630 18734 sys_catalog.cc:458] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:39.677700 18734 sys_catalog.cc:455] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "112dec87977444b9a74941e09be89dea" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: NON_VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: true } } }
I20260809 02:19:39.677750 18734 sys_catalog.cc:458] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:39.678002 18816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "112dec87977444b9a74941e09be89dea" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: NON_VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: true } } }
I20260809 02:19:39.678102 18816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:19:39.686465 18831 master.cc:552] Master@127.11.93.188:34943 shutdown complete.
I20260809 02:19:39.686523 18831 master_runner.cc:305] Clearing existing system tablet
I20260809 02:19:39.686652 18831 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:39.686708 18831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:39.687358 18831 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:39.687848 18935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:39.688005 18831 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:39.688066 18831 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:39.688087 18831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/wal
uuid: "bc09e44584e24b83bbbe6f6998fae662"
format_stamp: "Formatted at 2026-08-09 02:19:39 on dist-test-slave-w206"
server_key: "c2ece685b6d2f01717ef6992f28fea17"
server_key_iv: "8328f39a677e76692be02c93bb35cd51"
server_key_version: "encryptionkey@0"
I20260809 02:19:39.688719 18831 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:39.690076 18831 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 02:19:39.690132 18831 log.cc:1196] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260809 02:19:39.690332 18831 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662: Deleting consensus metadata
I20260809 02:19:39.690465 18831 master_runner.cc:315] Copying system tablet from 127.11.93.190:34587
I20260809 02:19:39.691102 18831 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662: tablet copy: Beginning tablet copy session from remote peer at address 127.11.93.190:34587
I20260809 02:19:39.697400 18182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.691460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45366 (local address 127.11.93.190:34587)
0809 02:19:39.691500 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:39.691502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:39.691618 (+ 116us) server_negotiation.cc:407] Connection header received
0809 02:19:39.691696 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:39.691697 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:39.691707 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:39.691764 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:39.692072 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.692560 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.693284 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.693493 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.693576 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.694560 (+ 984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:39.694561 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:39.694562 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:39.694569 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:39.696211 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.696610 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.696611 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.696612 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.696671 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.696874 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.696886 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.696886 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.696994 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:39.697067 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:39.697230 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 02:19:39.697308 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 02:19:39.697427 18941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.691417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.0.0.1:45366)
0809 02:19:39.691539 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:39.691550 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:39.691635 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:39.691769 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:39.691769 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:39.691951 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:39.691995 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.691997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.692642 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.692643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.693199 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.693201 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.693579 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.693580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.693647 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.694140 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:39.694145 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:39.694454 (+ 309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:39.696309 (+ 1855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.696310 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.696310 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.696512 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.696738 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.696739 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.696739 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.696799 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.697058 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:39.697059 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:39.697104 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 02:19:39.697204 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 02:19:39.697311 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":81,"threads_started":1}
I20260809 02:19:39.697945 18162 tablet_copy_service.cc:140] P 112dec87977444b9a74941e09be89dea: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer bc09e44584e24b83bbbe6f6998fae662 ({username='oryx', principal='oryx/127.11.93.188@KRBTEST.COM'} at 127.0.0.1:45366)
I20260809 02:19:39.698004 18162 tablet_copy_service.cc:161] P 112dec87977444b9a74941e09be89dea: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer bc09e44584e24b83bbbe6f6998fae662 at {username='oryx', principal='oryx/127.11.93.188@KRBTEST.COM'} at 127.0.0.1:45366: session id = bc09e44584e24b83bbbe6f6998fae662-00000000000000000000000000000000
I20260809 02:19:39.698437 18162 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 02:19:39.698927 18831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 02:19:39.699824 18831 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662: tablet copy: Starting download of 0 data blocks...
I20260809 02:19:39.699983 18831 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662: tablet copy: Starting download of 1 WAL segments...
I20260809 02:19:39.700767 18831 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 02:19:39.701491 18162 tablet_copy_service.cc:342] P 112dec87977444b9a74941e09be89dea: Request end of tablet copy session bc09e44584e24b83bbbe6f6998fae662-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.93.188@KRBTEST.COM'} at 127.0.0.1:45366
I20260809 02:19:39.701565 18162 tablet_copy_service.cc:433] P 112dec87977444b9a74941e09be89dea: ending tablet copy session bc09e44584e24b83bbbe6f6998fae662-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer bc09e44584e24b83bbbe6f6998fae662
I20260809 02:19:39.705185 18831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:39.706348 18942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:39.706427 18943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:39.706440 18945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:39.707193 18831 server_base.cc:1034] running on GCE node
I20260809 02:19:39.707286 18831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:39.707432 18831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:39.708544 18831 hybrid_clock.cc:648] HybridClock initialized: now 1786241979708537 us; error 23 us; skew 500 ppm
Aug 09 02:19:39 dist-test-slave-w206 krb5kdc[18095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241979, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:39.710104 18831 init.cc:377] Logged in from keytab as oryx/127.11.93.188@KRBTEST.COM (short username oryx)
I20260809 02:19:39.710434 18831 webserver.cc:460] Webserver started at http://127.11.93.188:44629/ using document root <none> and password file <none>
I20260809 02:19:39.710572 18831 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:39.710616 18831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:39.711443 18831 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:39.712134 18952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:39.712289 18831 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:19:39.712354 18831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/wal
uuid: "bc09e44584e24b83bbbe6f6998fae662"
format_stamp: "Formatted at 2026-08-09 02:19:39 on dist-test-slave-w206"
server_key: "c2ece685b6d2f01717ef6992f28fea17"
server_key_iv: "8328f39a677e76692be02c93bb35cd51"
server_key_version: "encryptionkey@0"
I20260809 02:19:39.712422 18831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:39.726451 18831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:39.728199 18831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:39.732136 18831 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.188:34943
I20260809 02:19:39.732476 19004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.188:34943 every 8 connection(s)
I20260809 02:19:39.732664 18831 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/master-2/data/info.pb
I20260809 02:19:39.733400 19005 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:19:39.733772 19005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662: Bootstrap starting.
I20260809 02:19:39.736228 19005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:19:39.736493 19005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662: Bootstrap complete.
I20260809 02:19:39.736732 19005 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: NON_VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: true } }
I20260809 02:19:39.736819 19005 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bc09e44584e24b83bbbe6f6998fae662, State: Initialized, Role: LEARNER
I20260809 02:19:39.736864 19005 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: NON_VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: true } }
I20260809 02:19:39.737067 19005 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:19:39.737061 19008 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: NON_VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: true } } }
I20260809 02:19:39.737149 19008 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [sys.catalog]: This master's current role is: LEARNER
I20260809 02:19:39.738511 19019 catalog_manager.cc:1259] Loaded cluster ID: 89ee773d252f4feeaa259289ca4934c0
I20260809 02:19:39.738569 19019 catalog_manager.cc:1552] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662: loading cluster ID for follower catalog manager: success
I20260809 02:19:39.739638 19019 catalog_manager.cc:1574] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662: acquiring CA information for follower catalog manager: success
I20260809 02:19:39.739986 19019 catalog_manager.cc:1602] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:19:39.782966 19020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.775967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49786 (local address 127.11.93.188:34943)
0809 02:19:39.776158 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:39.776160 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:39.776169 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:19:39.776194 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:39.776195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:39.776205 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:39.776295 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:39.776886 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.777639 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.778361 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.778588 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.778666 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.780109 (+ 1443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:39.780110 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:39.780110 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:39.780118 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:39.781752 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.782129 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.782130 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.782130 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.782192 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.782403 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.782403 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.782404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.782520 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:39.782640 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:39.782732 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 02:19:39.782827 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":85,"threads_started":1}
I20260809 02:19:39.783700 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 18206
I20260809 02:19:39.796407 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:35047
--local_ip_for_outbound_sockets=127.11.93.129
--tserver_master_addrs=127.11.93.190:34587
--webserver_port=38995
--webserver_interface=127.11.93.129
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.129.keytab
--principal=oryx/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.93.190:34587,127.11.93.189:41047
--tserver_master_addrs=127.11.93.190:34587,127.11.93.189:41047,127.11.93.188:34943 with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:39.880777 19021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:39.881002 19021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:39.881043 19021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:39.882272 19021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:39.882331 19021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:39.882382 19021 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:19:39.883912 19021 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.129.keytab
--principal=oryx/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:35047
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=38995
--tserver_master_addrs=127.11.93.190:34587,127.11.93.189:41047,127.11.93.188:34943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19021
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:39.884186 19021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:39.884403 19021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:39.889547 19027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:39.889529 19029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:39.889508 19026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:39.889838 19021 server_base.cc:1034] running on GCE node
I20260809 02:19:39.890025 19021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:39.890214 19021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:39.891374 19021 hybrid_clock.cc:648] HybridClock initialized: now 1786241979891365 us; error 38 us; skew 500 ppm
Aug 09 02:19:39 dist-test-slave-w206 krb5kdc[18095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241979, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:39.893836 19021 init.cc:377] Logged in from keytab as oryx/127.11.93.129@KRBTEST.COM (short username oryx)
I20260809 02:19:39.894295 19021 webserver.cc:460] Webserver started at http://127.11.93.129:38995/ using document root <none> and password file <none>
I20260809 02:19:39.894522 19021 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:39.894603 19021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:39.896138 19021 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:39.896777 19038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:39.896950 19021 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:39.897044 19021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "c5f9d1717edc41209ab8ed56702e13ba"
format_stamp: "Formatted at 2026-08-09 02:19:38 on dist-test-slave-w206"
server_key: "f4877635b484ac2b725ef68d6823a3d9"
server_key_iv: "bb59ffd35351868d4fc8c8954333dc16"
server_key_version: "encryptionkey@0"
I20260809 02:19:39.897396 19021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:39.929466 19021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:39.931458 19021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:39.931610 19021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:39.931850 19021 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:39.932160 19021 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:39.932210 19021 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:39.932251 19021 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:39.932283 19021 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:39.938759 19021 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:35047
I20260809 02:19:39.938812 19155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:35047 every 8 connection(s)
I20260809 02:19:39.939206 19021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:19:39.942631 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 19021
I20260809 02:19:39.942806 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 18347
Aug 09 02:19:39 dist-test-slave-w206 krb5kdc[18095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241979, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.188@KRBTEST.COM
Aug 09 02:19:39 dist-test-slave-w206 krb5kdc[18095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241979, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.189@KRBTEST.COM
Aug 09 02:19:39 dist-test-slave-w206 krb5kdc[18095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241979, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM
I20260809 02:19:39.951504 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:42749
--local_ip_for_outbound_sockets=127.11.93.130
--tserver_master_addrs=127.11.93.190:34587
--webserver_port=39761
--webserver_interface=127.11.93.130
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.130.keytab
--principal=oryx/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.93.190:34587,127.11.93.189:41047
--tserver_master_addrs=127.11.93.190:34587,127.11.93.189:41047,127.11.93.188:34943 with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:19:39.951802 19020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.940268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:35445 (local address 127.11.93.188:34943)
0809 02:19:39.940317 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:39.940320 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:39.941467 (+ 1147us) server_negotiation.cc:407] Connection header received
0809 02:19:39.941552 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:39.941553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:39.941567 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:39.941612 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:39.942264 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.943065 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.944564 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.944851 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.944902 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.948483 (+ 3581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:39.948485 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:39.948485 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:39.948493 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:39.950180 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.950689 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.950690 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.950691 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.950749 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.951059 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.951061 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.951061 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.951200 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:39.951244 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:39.951619 (+ 375us) server_negotiation.cc:299] Negotiation successful
0809 02:19:39.951707 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 02:19:39.951802 18182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.939866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:43551 (local address 127.11.93.190:34587)
0809 02:19:39.939955 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:39.939958 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:39.940179 (+ 221us) server_negotiation.cc:407] Connection header received
0809 02:19:39.941335 (+ 1156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:39.941336 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:39.941350 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:39.941406 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:39.942284 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.943071 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.946548 (+ 3477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.946822 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.946869 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.948803 (+ 1934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:39.948804 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:39.948805 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:39.948811 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:39.950456 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.950830 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.950831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.950832 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.950898 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.951136 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.951137 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.951137 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.951263 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:39.951306 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:39.951620 (+ 314us) server_negotiation.cc:299] Negotiation successful
0809 02:19:39.951705 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 02:19:39.952354 19163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.940211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:34943 (local address 127.11.93.129:35445)
0809 02:19:39.941413 (+ 1202us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:39.941422 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:39.941473 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:39.941615 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:39.941616 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:39.941961 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:39.942160 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.942165 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.943161 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.943162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.944468 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.944471 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.944987 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.944987 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.945146 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.945688 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:39.945697 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:39.948374 (+ 2677us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:39.950278 (+ 1904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.950286 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.950288 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.950603 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.950824 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.950825 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.950825 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.950958 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.951294 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:39.951300 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:39.951458 (+ 158us) client_negotiation.cc:769] Sending connection context
0809 02:19:39.951914 (+ 456us) client_negotiation.cc:240] Negotiation successful
0809 02:19:39.952116 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1186,"mutex_wait_us":92,"thread_start_us":61,"threads_started":1}
I20260809 02:19:39.952354 19161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.939855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.129:43551)
0809 02:19:39.940055 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:39.940095 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:39.941201 (+ 1106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:39.941507 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:39.941511 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:39.941970 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:39.942161 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.942166 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.945667 (+ 3501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.945668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.946442 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.946445 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.946952 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.946954 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.947037 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.947427 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:39.947432 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:39.948728 (+ 1296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:39.950544 (+ 1816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.950545 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.950546 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.950744 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.951004 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.951004 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.951005 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.951062 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.951350 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:39.951351 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:39.951458 (+ 107us) client_negotiation.cc:769] Sending connection context
0809 02:19:39.951907 (+ 449us) client_negotiation.cc:240] Negotiation successful
0809 02:19:39.952263 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":221,"thread_start_us":122,"threads_started":1}
I20260809 02:19:39.953280 19156 heartbeater.cc:347] Connected to a master server at 127.11.93.190:34587
I20260809 02:19:39.953414 19156 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:39.953558 19157 heartbeater.cc:347] Connected to a master server at 127.11.93.188:34943
I20260809 02:19:39.953603 19157 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:39.953631 19156 heartbeater.cc:511] Master 127.11.93.190:34587 requested a full tablet report, sending...
I20260809 02:19:39.953658 19157 heartbeater.cc:511] Master 127.11.93.188:34943 requested a full tablet report, sending...
I20260809 02:19:39.954161 18828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.939939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:53237 (local address 127.11.93.189:41047)
0809 02:19:39.939998 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:39.940001 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:39.940489 (+ 488us) server_negotiation.cc:407] Connection header received
0809 02:19:39.941362 (+ 873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:39.941364 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:39.941377 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:39.941429 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:39.942285 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.943034 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.944749 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.945090 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.945134 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.948534 (+ 3400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:39.948535 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:39.948536 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:39.948545 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:39.951180 (+ 2635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.951820 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.951821 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.951821 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.951884 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:39.952373 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:39.952374 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:39.952374 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:39.952524 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:39.952567 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:39.953987 (+ 1420us) server_negotiation.cc:299] Negotiation successful
0809 02:19:39.954064 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 02:19:39.954172 19162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:39.939856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:41047 (local address 127.11.93.129:53237)
0809 02:19:39.940398 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:39.940408 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:39.941215 (+ 807us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:39.941507 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:39.941511 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:39.941978 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:39.942160 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.942166 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.943160 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.943161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.944632 (+ 1471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:39.944636 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:39.945211 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:39.945213 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:39.945302 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:39.946077 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:39.946082 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:39.948388 (+ 2306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:39.951290 (+ 2902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.951291 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.951292 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.951512 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.952230 (+ 718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:39.952231 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:39.952231 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:39.952301 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:39.953207 (+ 906us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:39.953208 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:39.953851 (+ 643us) client_negotiation.cc:769] Sending connection context
0809 02:19:39.953945 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 02:19:39.954056 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"mutex_wait_us":75,"thread_start_us":125,"threads_started":1}
I20260809 02:19:39.954170 18140 ts_manager.cc:194] Re-registered known tserver with Master: c5f9d1717edc41209ab8ed56702e13ba (127.11.93.129:35047)
I20260809 02:19:39.954173 18969 ts_manager.cc:194] Registered new tserver with Master: c5f9d1717edc41209ab8ed56702e13ba (127.11.93.129:35047)
I20260809 02:19:39.954466 19159 heartbeater.cc:347] Connected to a master server at 127.11.93.189:41047
I20260809 02:19:39.954506 19159 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:39.954562 19159 heartbeater.cc:511] Master 127.11.93.189:41047 requested a full tablet report, sending...
I20260809 02:19:39.954659 18140 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:43551
I20260809 02:19:39.954943 18776 ts_manager.cc:194] Registered new tserver with Master: c5f9d1717edc41209ab8ed56702e13ba (127.11.93.129:35047)
W20260809 02:19:40.035980 19164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:40.036203 19164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:40.036242 19164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:40.037439 19164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:40.037498 19164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:40.037554 19164 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:19:40.039179 19164 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.130.keytab
--principal=oryx/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:42749
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=39761
--tserver_master_addrs=127.11.93.190:34587,127.11.93.189:41047,127.11.93.188:34943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19164
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:40.039438 19164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:40.039665 19164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:40.044768 19172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:40.044776 19164 server_base.cc:1034] running on GCE node
W20260809 02:19:40.044739 19169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:40.044759 19170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:40.045217 19164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:40.045455 19164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:40.046612 19164 hybrid_clock.cc:648] HybridClock initialized: now 1786241980046584 us; error 42 us; skew 500 ppm
Aug 09 02:19:40 dist-test-slave-w206 krb5kdc[18095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241980, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:40.049187 19164 init.cc:377] Logged in from keytab as oryx/127.11.93.130@KRBTEST.COM (short username oryx)
I20260809 02:19:40.049646 19164 webserver.cc:460] Webserver started at http://127.11.93.130:39761/ using document root <none> and password file <none>
I20260809 02:19:40.049847 19164 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:40.049911 19164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:40.051216 19164 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:19:40.051759 19179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:40.051959 19164 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:40.052066 19164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9"
format_stamp: "Formatted at 2026-08-09 02:19:38 on dist-test-slave-w206"
server_key: "7bd2b5ae6a6a28ae6ba1a60ddbe6a87f"
server_key_iv: "5925cca1f007ab06ea1a29a20e491d69"
server_key_version: "encryptionkey@0"
I20260809 02:19:40.052399 19164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:40.077907 19164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:40.080060 19164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:40.080230 19164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:40.080459 19164 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:40.080783 19164 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:40.080817 19164 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:40.080859 19164 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:40.080884 19164 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:40.086859 19164 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:42749
I20260809 02:19:40.086937 19299 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:42749 every 8 connection(s)
I20260809 02:19:40.087312 19164 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:19:40.088241 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 19164
I20260809 02:19:40.088431 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 18487
Aug 09 02:19:40 dist-test-slave-w206 krb5kdc[18095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241980, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM
I20260809 02:19:40.099311 18182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.088055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:55941 (local address 127.11.93.190:34587)
0809 02:19:40.088130 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:40.088133 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:40.088345 (+ 212us) server_negotiation.cc:407] Connection header received
0809 02:19:40.089547 (+ 1202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:40.089549 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:40.089564 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:40.089657 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:40.090242 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.091288 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.092277 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.092670 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.092753 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.095429 (+ 2676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:40.095431 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:40.095431 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:40.095439 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:40.097768 (+ 2329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:40.098174 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:40.098175 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:40.098176 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:40.098240 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:40.098544 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:40.098546 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:40.098546 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:40.098683 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:40.098728 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:40.099103 (+ 375us) server_negotiation.cc:299] Negotiation successful
0809 02:19:40.099188 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:19:40.099900 19305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.088049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.130:55941)
0809 02:19:40.088217 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:40.088260 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:40.089438 (+ 1178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:40.089705 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:40.089708 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:40.089968 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:40.090160 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.090164 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.091384 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.091385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.092196 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.092198 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.092754 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.092755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.092859 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.093420 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:40.093428 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:40.095317 (+ 1889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:40.097860 (+ 2543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:40.097866 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:40.097869 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:40.098091 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:40.098312 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:40.098312 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:40.098313 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:40.098459 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:40.098776 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:40.098782 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:40.098930 (+ 148us) client_negotiation.cc:769] Sending connection context
0809 02:19:40.099468 (+ 538us) client_negotiation.cc:240] Negotiation successful
0809 02:19:40.099641 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":100,"threads_started":1}
I20260809 02:19:40.100905 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:37587
--local_ip_for_outbound_sockets=127.11.93.131
--tserver_master_addrs=127.11.93.190:34587
--webserver_port=42889
--webserver_interface=127.11.93.131
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.131.keytab
--principal=oryx/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.93.190:34587,127.11.93.189:41047
--tserver_master_addrs=127.11.93.190:34587,127.11.93.189:41047,127.11.93.188:34943 with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:19:40 dist-test-slave-w206 krb5kdc[18095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241980, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.188@KRBTEST.COM
I20260809 02:19:40.102219 19301 heartbeater.cc:347] Connected to a master server at 127.11.93.190:34587
I20260809 02:19:40.102353 19301 heartbeater.cc:464] Registering TS with master...
Aug 09 02:19:40 dist-test-slave-w206 krb5kdc[18095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241980, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.189@KRBTEST.COM
I20260809 02:19:40.102638 19301 heartbeater.cc:511] Master 127.11.93.190:34587 requested a full tablet report, sending...
I20260809 02:19:40.103165 18140 ts_manager.cc:194] Re-registered known tserver with Master: ddbaeb0e974f4cb98ce1bb675b60e5c9 (127.11.93.130:42749)
I20260809 02:19:40.103700 18140 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:55941
I20260809 02:19:40.105154 19307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.088382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:34943 (local address 127.11.93.130:38685)
0809 02:19:40.095779 (+ 7397us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:40.095792 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:40.095848 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:40.096898 (+ 1050us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:40.096899 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:40.097065 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:40.097144 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.097146 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.098322 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.098323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.099192 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.099194 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.099700 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.099701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.099764 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.100199 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:40.100204 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:40.102091 (+ 1887us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:40.104090 (+ 1999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:40.104091 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:40.104092 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:40.104294 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:40.104513 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:40.104514 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:40.104514 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:40.104579 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:40.104828 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:40.104829 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:40.104870 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 02:19:40.104944 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 02:19:40.105047 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7377,"thread_start_us":82,"threads_started":1}
I20260809 02:19:40.105154 19020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.088791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:38685 (local address 127.11.93.188:34943)
0809 02:19:40.096765 (+ 7974us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:40.096767 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:40.096776 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:19:40.096803 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:40.096805 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:40.096815 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:40.096870 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:40.097263 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.098075 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.099289 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.099571 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.099620 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.102189 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:40.102190 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:40.102191 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:40.102199 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:40.103998 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:40.104381 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:40.104382 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:40.104383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:40.104441 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:40.104641 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:40.104642 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:40.104642 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:40.104758 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:40.104826 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:40.104981 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 02:19:40.105067 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7942}
I20260809 02:19:40.105463 19302 heartbeater.cc:347] Connected to a master server at 127.11.93.188:34943
I20260809 02:19:40.105515 19302 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:40.105600 19302 heartbeater.cc:511] Master 127.11.93.188:34943 requested a full tablet report, sending...
I20260809 02:19:40.105955 18969 ts_manager.cc:194] Registered new tserver with Master: ddbaeb0e974f4cb98ce1bb675b60e5c9 (127.11.93.130:42749)
I20260809 02:19:40.109612 18828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.088844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:44825 (local address 127.11.93.189:41047)
0809 02:19:40.088888 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:40.088889 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:40.095975 (+ 7086us) server_negotiation.cc:407] Connection header received
0809 02:19:40.096067 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:40.096068 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:40.096082 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:40.096111 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:40.096554 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.097217 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.099248 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.099608 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.099657 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.107076 (+ 7419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:40.107077 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:40.107078 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:40.107086 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:40.108500 (+ 1414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:40.108859 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:40.108860 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:40.108860 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:40.108924 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:40.109116 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:40.109116 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:40.109117 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:40.109224 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:40.109295 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:40.109446 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 02:19:40.109522 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 02:19:40.109814 19306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.088584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:41047 (local address 127.11.93.130:44825)
0809 02:19:40.095923 (+ 7339us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:40.095931 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:40.096000 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:40.096173 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:40.096173 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:40.096398 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:40.096469 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.096471 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.098184 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.098185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.099144 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.099147 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.099745 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.099747 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.099826 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.100362 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:40.100367 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:40.103270 (+ 2903us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:40.108598 (+ 5328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:40.108599 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:40.108600 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:40.108780 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:40.108987 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:40.108988 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:40.108989 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:40.109045 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:40.109286 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:40.109287 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:40.109330 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 02:19:40.109406 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 02:19:40.109522 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7326,"thread_start_us":54,"threads_started":1}
I20260809 02:19:40.110272 19303 heartbeater.cc:347] Connected to a master server at 127.11.93.189:41047
I20260809 02:19:40.110334 19303 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:40.110392 19303 heartbeater.cc:511] Master 127.11.93.189:41047 requested a full tablet report, sending...
I20260809 02:19:40.110697 18776 ts_manager.cc:194] Registered new tserver with Master: ddbaeb0e974f4cb98ce1bb675b60e5c9 (127.11.93.130:42749)
I20260809 02:19:40.165069 19020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.162480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49788 (local address 127.11.93.188:34943)
0809 02:19:40.162548 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:40.162551 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:40.162563 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:19:40.162655 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:40.162657 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:40.162684 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:40.162779 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:40.162923 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.163468 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.164357 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.164754 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.164838 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.164920 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:40.164950 (+ 30us) server_negotiation.cc:299] Negotiation successful
0809 02:19:40.164988 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 02:19:40.165069 18731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.162403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:34943 (local address 127.0.0.1:49788)
0809 02:19:40.162475 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:40.162488 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:40.162566 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:40.162787 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:40.162788 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:40.162790 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:40.162850 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.162855 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.163557 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.163559 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.164267 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.164269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.164839 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.164840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.164903 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.164906 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:19:40.164948 (+ 42us) client_negotiation.cc:240] Negotiation successful
0809 02:19:40.164996 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 02:19:40.166285 18979 raft_consensus.cc:1203] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260809 02:19:40.166457 19008 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 112dec87977444b9a74941e09be89dea. Latest consensus state: current_term: 1 leader_uuid: "112dec87977444b9a74941e09be89dea" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: NON_VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: true } } }
I20260809 02:19:40.166599 19008 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [sys.catalog]: This master's current role is: LEARNER
W20260809 02:19:40.187963 19308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:40.188167 19308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:40.188197 19308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:40.189349 19308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:40.189389 19308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:40.189440 19308 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:19:40.190949 19308 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.131.keytab
--principal=oryx/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:37587
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=42889
--tserver_master_addrs=127.11.93.190:34587,127.11.93.189:41047,127.11.93.188:34943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:40.191252 19308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:40.191497 19308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:40.196563 19314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:40.196568 19317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:40.196605 19315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:40.196714 19308 server_base.cc:1034] running on GCE node
I20260809 02:19:40.197008 19308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:40.197256 19308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:40.198400 19308 hybrid_clock.cc:648] HybridClock initialized: now 1786241980198391 us; error 29 us; skew 500 ppm
Aug 09 02:19:40 dist-test-slave-w206 krb5kdc[18095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241980, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:40.200956 19308 init.cc:377] Logged in from keytab as oryx/127.11.93.131@KRBTEST.COM (short username oryx)
I20260809 02:19:40.201452 19308 webserver.cc:460] Webserver started at http://127.11.93.131:42889/ using document root <none> and password file <none>
I20260809 02:19:40.201707 19308 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:40.201767 19308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:40.203184 19308 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:40.203805 19324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:40.203976 19308 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:40.204063 19308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf"
format_stamp: "Formatted at 2026-08-09 02:19:39 on dist-test-slave-w206"
server_key: "70ebc34ce1599ff3e5068faa8da2ac92"
server_key_iv: "943bd43f4850aafc43ca5a2b520bd44a"
server_key_version: "encryptionkey@0"
I20260809 02:19:40.204432 19308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:40.220860 19308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:40.222942 19308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:40.223141 19308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:40.223416 19308 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:40.223732 19308 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:40.223765 19308 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:40.223788 19308 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:40.223830 19308 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:40.229776 19308 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:37587
I20260809 02:19:40.229820 19446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:37587 every 8 connection(s)
I20260809 02:19:40.230154 19308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:19:40.237658 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 19308
Aug 09 02:19:40 dist-test-slave-w206 krb5kdc[18095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241980, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.188@KRBTEST.COM
Aug 09 02:19:40 dist-test-slave-w206 krb5kdc[18095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241980, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM
Aug 09 02:19:40 dist-test-slave-w206 krb5kdc[18095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241980, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.189@KRBTEST.COM
I20260809 02:19:40.244984 19020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.231450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:55731 (local address 127.11.93.188:34943)
0809 02:19:40.231495 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:40.231519 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:40.231792 (+ 273us) server_negotiation.cc:407] Connection header received
0809 02:19:40.232871 (+ 1079us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:40.232873 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:40.232886 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:40.232919 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:40.234071 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.234850 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.236536 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.237040 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.237082 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.241559 (+ 4477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:40.241560 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:40.241561 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:40.241567 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:40.243346 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:40.243800 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:40.243801 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:40.243801 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:40.243874 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:40.244179 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:40.244180 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:40.244181 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:40.244311 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:40.244370 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:40.244798 (+ 428us) server_negotiation.cc:299] Negotiation successful
0809 02:19:40.244892 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 02:19:40.245122 19452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.230881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:41047 (local address 127.11.93.131:38429)
0809 02:19:40.231284 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:40.231328 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:40.232742 (+ 1414us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:40.233110 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:40.233115 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:40.233648 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:40.233983 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.233986 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.235061 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.235062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.236429 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.236433 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.237055 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.237055 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.237124 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.238756 (+ 1632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:40.238761 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:40.241390 (+ 2629us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:40.243296 (+ 1906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:40.243303 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:40.243306 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:40.243715 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:40.243950 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:40.243950 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:40.243951 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:40.244103 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:40.244409 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:40.244409 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:40.244575 (+ 166us) client_negotiation.cc:769] Sending connection context
0809 02:19:40.244710 (+ 135us) client_negotiation.cc:240] Negotiation successful
0809 02:19:40.244889 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":110,"thread_start_us":112,"threads_started":1}
I20260809 02:19:40.245321 19453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.231565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:34943 (local address 127.11.93.131:55731)
0809 02:19:40.231733 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:40.231743 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:40.232755 (+ 1012us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:40.233110 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:40.233114 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:40.233631 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:40.233957 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.233963 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.234999 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.234999 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.236431 (+ 1432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.236434 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.237154 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.237155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.237211 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.237930 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:40.237940 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:40.241462 (+ 3522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:40.243425 (+ 1963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:40.243425 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:40.243426 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:40.243715 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:40.243952 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:40.243952 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:40.243953 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:40.244103 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:40.244398 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:40.244406 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:40.244575 (+ 169us) client_negotiation.cc:769] Sending connection context
0809 02:19:40.244711 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 02:19:40.245197 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":456,"thread_start_us":78,"threads_started":1}
I20260809 02:19:40.245373 18182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.230865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:40783 (local address 127.11.93.190:34587)
0809 02:19:40.230928 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:40.230930 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:40.231417 (+ 487us) server_negotiation.cc:407] Connection header received
0809 02:19:40.232910 (+ 1493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:40.232912 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:40.232952 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:40.232984 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:40.234108 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.235108 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.236536 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.236829 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.236870 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.241741 (+ 4871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:40.241743 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:40.241743 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:40.241751 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:40.243955 (+ 2204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:40.244356 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:40.244357 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:40.244357 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:40.244415 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:40.244613 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:40.244614 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:40.244614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:40.244733 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:40.244788 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:40.245186 (+ 398us) server_negotiation.cc:299] Negotiation successful
0809 02:19:40.245281 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 02:19:40.245131 19451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.230881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.131:40783)
0809 02:19:40.231283 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:40.231327 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:40.232776 (+ 1449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:40.233119 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:40.233119 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:40.233643 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:40.233972 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.233973 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.235260 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.235261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.236431 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.236434 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.236962 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.236963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.237102 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.238117 (+ 1015us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:40.238122 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:40.241645 (+ 3523us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:40.244043 (+ 2398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:40.244044 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:40.244044 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:40.244279 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:40.244480 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:40.244481 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:40.244481 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:40.244536 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:40.244811 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:40.244812 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:40.244850 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 02:19:40.244909 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 02:19:40.245004 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"mutex_wait_us":35,"thread_start_us":236,"threads_started":1}
I20260809 02:19:40.245832 18828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.230917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:38429 (local address 127.11.93.189:41047)
0809 02:19:40.230969 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:40.230991 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:40.231428 (+ 437us) server_negotiation.cc:407] Connection header received
0809 02:19:40.232889 (+ 1461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:40.232891 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:40.232906 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:40.232940 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:40.234100 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.234925 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.236539 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.236857 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.236917 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.241482 (+ 4565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:40.241484 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:40.241484 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:40.241493 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:40.243198 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:40.243801 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:40.243802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:40.243803 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:40.243874 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:40.244180 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:40.244180 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:40.244181 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:40.244312 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:40.244370 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:40.245663 (+ 1293us) server_negotiation.cc:299] Negotiation successful
0809 02:19:40.245738 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 02:19:40.246186 19447 heartbeater.cc:347] Connected to a master server at 127.11.93.190:34587
I20260809 02:19:40.246287 19447 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:40.246470 19447 heartbeater.cc:511] Master 127.11.93.190:34587 requested a full tablet report, sending...
I20260809 02:19:40.246832 19449 heartbeater.cc:347] Connected to a master server at 127.11.93.189:41047
I20260809 02:19:40.246892 19449 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:40.246961 19449 heartbeater.cc:511] Master 127.11.93.189:41047 requested a full tablet report, sending...
I20260809 02:19:40.247051 19448 heartbeater.cc:347] Connected to a master server at 127.11.93.188:34943
I20260809 02:19:40.247104 19448 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:40.247123 18140 ts_manager.cc:194] Re-registered known tserver with Master: 887dc57e6fcd4c4fa6ef7f208b093ddf (127.11.93.131:37587)
I20260809 02:19:40.247169 19448 heartbeater.cc:511] Master 127.11.93.188:34943 requested a full tablet report, sending...
I20260809 02:19:40.247481 18140 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:40783
I20260809 02:19:40.247902 18776 ts_manager.cc:194] Registered new tserver with Master: 887dc57e6fcd4c4fa6ef7f208b093ddf (127.11.93.131:37587)
I20260809 02:19:40.247933 18969 ts_manager.cc:194] Registered new tserver with Master: 887dc57e6fcd4c4fa6ef7f208b093ddf (127.11.93.131:37587)
I20260809 02:19:40.252226 19463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.241971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45370 (local address 127.11.93.190:34587)
0809 02:19:40.242077 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:40.242079 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:40.242356 (+ 277us) server_negotiation.cc:407] Connection header received
0809 02:19:40.242377 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:40.242378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:40.242391 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:40.242449 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:40.243298 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.244086 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.245165 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.245625 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.245682 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.247463 (+ 1781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:40.247464 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:40.247464 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:40.247470 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:40.249395 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:40.250665 (+ 1270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:40.250666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:40.250667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:40.250752 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:40.251029 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:40.251030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:40.251031 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:40.251168 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:40.251274 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:40.251926 (+ 652us) server_negotiation.cc:299] Negotiation successful
0809 02:19:40.252123 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82,"thread_start_us":56,"threads_started":1}
I20260809 02:19:40.254268 19462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.239636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49794 (local address 127.11.93.188:34943)
0809 02:19:40.239772 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:40.239774 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:40.239783 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:19:40.239845 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:40.239846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:40.239859 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:40.239940 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:40.245649 (+ 5709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.246680 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.248806 (+ 2126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.249120 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.249198 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.250475 (+ 1277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:40.250476 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:40.250476 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:40.250484 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:40.252096 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:40.252960 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:40.252961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:40.252962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:40.253279 (+ 317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:40.253539 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:40.253540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:40.253541 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:40.253672 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:40.253781 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:40.254077 (+ 296us) server_negotiation.cc:299] Negotiation successful
0809 02:19:40.254163 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":67,"threads_started":1}
I20260809 02:19:40.254565 19458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.239211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49048 (local address 127.11.93.189:41047)
0809 02:19:40.239488 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:40.239490 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:40.239799 (+ 309us) server_negotiation.cc:407] Connection header received
0809 02:19:40.239929 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:40.239931 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:40.239944 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:40.240009 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:40.240903 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.241693 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.249302 (+ 7609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.249626 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.249706 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.251366 (+ 1660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:40.251367 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:40.251367 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:40.251374 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:40.253228 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:40.253683 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:40.253684 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:40.253684 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:40.253744 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:40.254005 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:40.254006 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:40.254007 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:40.254146 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:40.254243 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:40.254400 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 02:19:40.254485 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":56,"threads_started":1}
I20260809 02:19:40.254050 18140 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45370:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:19:40.256282 18140 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:19:40.257045 18931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "112dec87977444b9a74941e09be89dea" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: NON_VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: true } } }
I20260809 02:19:40.257135 18931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:40.258579 19468 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea: attempting to promote NON_VOTER bc09e44584e24b83bbbe6f6998fae662 to VOTER
I20260809 02:19:40.258703 19468 consensus_queue.cc:237] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: false } }
I20260809 02:19:40.259172 18979 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 1 LEARNER]: Refusing update from remote peer 112dec87977444b9a74941e09be89dea: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260809 02:19:40.259203 18787 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 1 FOLLOWER]: Refusing update from remote peer 112dec87977444b9a74941e09be89dea: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260809 02:19:40.259385 19466 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260809 02:19:40.259479 19469 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260809 02:19:40.260262 19466 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, bc09e44584e24b83bbbe6f6998fae662 (127.11.93.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: false } } }
I20260809 02:19:40.260427 18787 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, bc09e44584e24b83bbbe6f6998fae662 (127.11.93.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: false } } }
I20260809 02:19:40.260433 18979 raft_consensus.cc:2932] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, bc09e44584e24b83bbbe6f6998fae662 (127.11.93.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: false } } }
I20260809 02:19:40.261197 19468 sys_catalog.cc:455] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "112dec87977444b9a74941e09be89dea" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: false } } }
I20260809 02:19:40.261291 19468 sys_catalog.cc:458] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:40.261346 19468 sys_catalog.cc:455] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "112dec87977444b9a74941e09be89dea" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: false } } }
I20260809 02:19:40.261407 19468 sys_catalog.cc:458] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:40.261412 19008 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "112dec87977444b9a74941e09be89dea" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: false } } }
I20260809 02:19:40.261198 19466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "112dec87977444b9a74941e09be89dea" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: false } } }
I20260809 02:19:40.261511 19008 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:19:40.261518 19466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:40.261853 19477 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "112dec87977444b9a74941e09be89dea" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: false } } }
I20260809 02:19:40.261950 19477 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:19:40.266651 19479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.262516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:37587 (local address 127.0.0.1:33832)
0809 02:19:40.262729 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:40.262767 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:40.262854 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:40.263231 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:40.263232 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:40.263234 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:40.263308 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.263310 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.264637 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.264638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.265755 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.265758 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.266396 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.266397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.266463 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.266468 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:19:40.266529 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 02:19:40.266572 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":3,"thread_start_us":92,"threads_started":1}
I20260809 02:19:40.266870 19480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.262744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33832 (local address 127.11.93.131:37587)
0809 02:19:40.263046 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:40.263050 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:40.263062 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:19:40.263107 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:40.263109 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:40.263127 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:40.263388 (+ 261us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:40.263453 (+ 65us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.264550 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.265843 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.266310 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.266396 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.266475 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:40.266564 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 02:19:40.266609 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":82,"threads_started":1}
I20260809 02:19:40.267612 19478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.262593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:42749 (local address 127.0.0.1:33132)
0809 02:19:40.263001 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:40.263012 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:40.263059 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:40.263322 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:40.263323 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:40.263325 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:40.263388 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.263390 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.264500 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.264501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.265756 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.265758 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.267355 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.267356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.267431 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.267436 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:19:40.267500 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 02:19:40.267543 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"mutex_wait_us":59,"thread_start_us":89,"threads_started":1}
I20260809 02:19:40.267652 19482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.262941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33132 (local address 127.11.93.130:42749)
0809 02:19:40.263165 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:40.263169 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:40.263180 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:19:40.263221 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:40.263223 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:40.263235 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:40.263325 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:40.263448 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.264416 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.266516 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.267269 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.267343 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.267415 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:40.267523 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 02:19:40.267564 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":156,"threads_started":1}
I20260809 02:19:40.267632 19375 tablet_service.cc:1467] Processing CreateTablet for tablet 88a9959f6e9c41cca690b9dedd537568 (DEFAULT_TABLE table=test-table [id=b25dba69cfba4ed9a3b69180a56fe97e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:40.267964 18731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.262505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:35047 (local address 127.0.0.1:34616)
0809 02:19:40.262718 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:40.262731 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:40.262774 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:40.263343 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:40.263343 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:40.263345 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:40.263375 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.263376 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.265853 (+ 2477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.265853 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.266778 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.266781 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.267746 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.267747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.267831 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.267835 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:19:40.267868 (+ 33us) client_negotiation.cc:240] Negotiation successful
0809 02:19:40.267907 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194}
I20260809 02:19:40.268034 19375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88a9959f6e9c41cca690b9dedd537568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:40.268282 19481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.262673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34616 (local address 127.11.93.129:35047)
0809 02:19:40.263180 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:40.263183 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:40.263194 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:19:40.263229 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:40.263231 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:40.263246 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:40.263449 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:40.263510 (+ 61us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.264548 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.266873 (+ 2325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.267637 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.268078 (+ 441us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.268172 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:40.268193 (+ 21us) server_negotiation.cc:299] Negotiation successful
0809 02:19:40.268224 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":208,"threads_started":1}
I20260809 02:19:40.268263 19228 tablet_service.cc:1467] Processing CreateTablet for tablet 88a9959f6e9c41cca690b9dedd537568 (DEFAULT_TABLE table=test-table [id=b25dba69cfba4ed9a3b69180a56fe97e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:40.268569 19228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88a9959f6e9c41cca690b9dedd537568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:40.268824 19088 tablet_service.cc:1467] Processing CreateTablet for tablet 88a9959f6e9c41cca690b9dedd537568 (DEFAULT_TABLE table=test-table [id=b25dba69cfba4ed9a3b69180a56fe97e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:40.269146 19088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88a9959f6e9c41cca690b9dedd537568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:40.271772 19483 tablet_bootstrap.cc:492] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf: Bootstrap starting.
I20260809 02:19:40.272095 19484 tablet_bootstrap.cc:492] T 88a9959f6e9c41cca690b9dedd537568 P c5f9d1717edc41209ab8ed56702e13ba: Bootstrap starting.
I20260809 02:19:40.272110 19485 tablet_bootstrap.cc:492] T 88a9959f6e9c41cca690b9dedd537568 P ddbaeb0e974f4cb98ce1bb675b60e5c9: Bootstrap starting.
I20260809 02:19:40.272753 19485 tablet_bootstrap.cc:654] T 88a9959f6e9c41cca690b9dedd537568 P ddbaeb0e974f4cb98ce1bb675b60e5c9: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:40.272806 19484 tablet_bootstrap.cc:654] T 88a9959f6e9c41cca690b9dedd537568 P c5f9d1717edc41209ab8ed56702e13ba: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:40.272950 19483 tablet_bootstrap.cc:654] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:40.273240 19485 log.cc:824] T 88a9959f6e9c41cca690b9dedd537568 P ddbaeb0e974f4cb98ce1bb675b60e5c9: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:40.273243 19484 log.cc:824] T 88a9959f6e9c41cca690b9dedd537568 P c5f9d1717edc41209ab8ed56702e13ba: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:40.273243 19483 log.cc:824] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:40.273986 19484 tablet_bootstrap.cc:492] T 88a9959f6e9c41cca690b9dedd537568 P c5f9d1717edc41209ab8ed56702e13ba: No bootstrap required, opened a new log
I20260809 02:19:40.274021 19485 tablet_bootstrap.cc:492] T 88a9959f6e9c41cca690b9dedd537568 P ddbaeb0e974f4cb98ce1bb675b60e5c9: No bootstrap required, opened a new log
I20260809 02:19:40.274061 19484 ts_tablet_manager.cc:1397] T 88a9959f6e9c41cca690b9dedd537568 P c5f9d1717edc41209ab8ed56702e13ba: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:19:40.274097 19485 ts_tablet_manager.cc:1397] T 88a9959f6e9c41cca690b9dedd537568 P ddbaeb0e974f4cb98ce1bb675b60e5c9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:19:40.274266 19483 tablet_bootstrap.cc:492] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf: No bootstrap required, opened a new log
I20260809 02:19:40.274333 19483 ts_tablet_manager.cc:1397] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 02:19:40.276091 19485 raft_consensus.cc:348] T 88a9959f6e9c41cca690b9dedd537568 P ddbaeb0e974f4cb98ce1bb675b60e5c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f9d1717edc41209ab8ed56702e13ba" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35047 } } peers { permanent_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 42749 } } peers { permanent_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37587 } }
I20260809 02:19:40.276242 19485 raft_consensus.cc:374] T 88a9959f6e9c41cca690b9dedd537568 P ddbaeb0e974f4cb98ce1bb675b60e5c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:40.276280 19485 raft_consensus.cc:729] T 88a9959f6e9c41cca690b9dedd537568 P ddbaeb0e974f4cb98ce1bb675b60e5c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddbaeb0e974f4cb98ce1bb675b60e5c9, State: Initialized, Role: FOLLOWER
I20260809 02:19:40.276306 19484 raft_consensus.cc:348] T 88a9959f6e9c41cca690b9dedd537568 P c5f9d1717edc41209ab8ed56702e13ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f9d1717edc41209ab8ed56702e13ba" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35047 } } peers { permanent_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 42749 } } peers { permanent_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37587 } }
I20260809 02:19:40.276453 19484 raft_consensus.cc:374] T 88a9959f6e9c41cca690b9dedd537568 P c5f9d1717edc41209ab8ed56702e13ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:40.276428 19485 consensus_queue.cc:260] T 88a9959f6e9c41cca690b9dedd537568 P ddbaeb0e974f4cb98ce1bb675b60e5c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f9d1717edc41209ab8ed56702e13ba" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35047 } } peers { permanent_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 42749 } } peers { permanent_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37587 } }
I20260809 02:19:40.276494 19484 raft_consensus.cc:729] T 88a9959f6e9c41cca690b9dedd537568 P c5f9d1717edc41209ab8ed56702e13ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f9d1717edc41209ab8ed56702e13ba, State: Initialized, Role: FOLLOWER
I20260809 02:19:40.276623 19484 consensus_queue.cc:260] T 88a9959f6e9c41cca690b9dedd537568 P c5f9d1717edc41209ab8ed56702e13ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f9d1717edc41209ab8ed56702e13ba" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35047 } } peers { permanent_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 42749 } } peers { permanent_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37587 } }
I20260809 02:19:40.276577 19483 raft_consensus.cc:348] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f9d1717edc41209ab8ed56702e13ba" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35047 } } peers { permanent_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 42749 } } peers { permanent_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37587 } }
I20260809 02:19:40.276712 19483 raft_consensus.cc:374] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:40.276758 19483 raft_consensus.cc:729] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 887dc57e6fcd4c4fa6ef7f208b093ddf, State: Initialized, Role: FOLLOWER
I20260809 02:19:40.276770 19485 ts_tablet_manager.cc:1428] T 88a9959f6e9c41cca690b9dedd537568 P ddbaeb0e974f4cb98ce1bb675b60e5c9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 02:19:40.276887 19484 ts_tablet_manager.cc:1428] T 88a9959f6e9c41cca690b9dedd537568 P c5f9d1717edc41209ab8ed56702e13ba: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 02:19:40.276906 19301 heartbeater.cc:503] Master 127.11.93.190:34587 was elected leader, sending a full tablet report...
I20260809 02:19:40.276882 19483 consensus_queue.cc:260] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f9d1717edc41209ab8ed56702e13ba" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35047 } } peers { permanent_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 42749 } } peers { permanent_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37587 } }
I20260809 02:19:40.276997 19156 heartbeater.cc:503] Master 127.11.93.190:34587 was elected leader, sending a full tablet report...
I20260809 02:19:40.278024 19483 ts_tablet_manager.cc:1428] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260809 02:19:40.278142 19447 heartbeater.cc:503] Master 127.11.93.190:34587 was elected leader, sending a full tablet report...
W20260809 02:19:40.338120 19304 tablet.cc:2369] T 88a9959f6e9c41cca690b9dedd537568 P ddbaeb0e974f4cb98ce1bb675b60e5c9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:19:40.440052 19160 tablet.cc:2369] T 88a9959f6e9c41cca690b9dedd537568 P c5f9d1717edc41209ab8ed56702e13ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:19:40.465075 19492 raft_consensus.cc:482] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:19:40.465204 19492 raft_consensus.cc:504] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f9d1717edc41209ab8ed56702e13ba" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35047 } } peers { permanent_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 42749 } } peers { permanent_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37587 } }
I20260809 02:19:40.465660 19492 leader_election.cc:288] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f9d1717edc41209ab8ed56702e13ba (127.11.93.129:35047), ddbaeb0e974f4cb98ce1bb675b60e5c9 (127.11.93.130:42749)
I20260809 02:19:40.468662 19482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.466089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:34833 (local address 127.11.93.130:42749)
0809 02:19:40.466156 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:40.466158 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:40.466168 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:19:40.466199 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:40.466200 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:40.466208 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:40.466314 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:40.466462 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.466935 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.467940 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.468305 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.468387 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.468396 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:40.468551 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 02:19:40.468586 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 02:19:40.468701 19451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.465876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:35047 (local address 127.11.93.131:45927)
0809 02:19:40.465920 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:40.465933 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:40.465984 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:40.466158 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:40.466160 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:40.466163 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:40.466354 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.466356 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.467034 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.467035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.467845 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.467847 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.468418 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.468419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.468494 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.468496 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 02:19:40.468567 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 02:19:40.468609 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21,"mutex_wait_us":41}
I20260809 02:19:40.468686 19481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.465934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:45927 (local address 127.11.93.129:35047)
0809 02:19:40.465990 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:40.465992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:40.466008 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:19:40.466044 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:40.466045 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:40.466056 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:40.466136 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:40.466450 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.466926 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.467964 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.468320 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.468417 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.468425 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:40.468576 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 02:19:40.468616 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 02:19:40.468739 19453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.466019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:42749 (local address 127.11.93.131:34833)
0809 02:19:40.466066 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:40.466074 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:40.466122 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:40.466317 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:40.466318 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:40.466319 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:40.466386 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.466387 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.467060 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.467061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.467846 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:40.467848 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.468384 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.468385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:40.468468 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.468471 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:19:40.468543 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 02:19:40.468585 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":16}
I20260809 02:19:40.469137 19108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a9959f6e9c41cca690b9dedd537568" candidate_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f9d1717edc41209ab8ed56702e13ba" is_pre_election: true
I20260809 02:19:40.469149 19250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a9959f6e9c41cca690b9dedd537568" candidate_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" is_pre_election: true
I20260809 02:19:40.469295 19108 raft_consensus.cc:2454] T 88a9959f6e9c41cca690b9dedd537568 P c5f9d1717edc41209ab8ed56702e13ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 887dc57e6fcd4c4fa6ef7f208b093ddf in term 0.
I20260809 02:19:40.469300 19250 raft_consensus.cc:2454] T 88a9959f6e9c41cca690b9dedd537568 P ddbaeb0e974f4cb98ce1bb675b60e5c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 887dc57e6fcd4c4fa6ef7f208b093ddf in term 0.
I20260809 02:19:40.469525 19325 leader_election.cc:302] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 887dc57e6fcd4c4fa6ef7f208b093ddf, c5f9d1717edc41209ab8ed56702e13ba; no voters:
I20260809 02:19:40.469669 19492 raft_consensus.cc:2781] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:19:40.469735 19492 raft_consensus.cc:482] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:19:40.469753 19492 raft_consensus.cc:3037] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:40.470502 19492 raft_consensus.cc:504] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f9d1717edc41209ab8ed56702e13ba" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35047 } } peers { permanent_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 42749 } } peers { permanent_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37587 } }
I20260809 02:19:40.470644 19492 leader_election.cc:288] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf [CANDIDATE]: Term 1 election: Requested vote from peers c5f9d1717edc41209ab8ed56702e13ba (127.11.93.129:35047), ddbaeb0e974f4cb98ce1bb675b60e5c9 (127.11.93.130:42749)
I20260809 02:19:40.470829 19108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a9959f6e9c41cca690b9dedd537568" candidate_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f9d1717edc41209ab8ed56702e13ba"
I20260809 02:19:40.470845 19250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a9959f6e9c41cca690b9dedd537568" candidate_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9"
I20260809 02:19:40.470923 19250 raft_consensus.cc:3037] T 88a9959f6e9c41cca690b9dedd537568 P ddbaeb0e974f4cb98ce1bb675b60e5c9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:40.470927 19108 raft_consensus.cc:3037] T 88a9959f6e9c41cca690b9dedd537568 P c5f9d1717edc41209ab8ed56702e13ba [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:40.471771 19108 raft_consensus.cc:2454] T 88a9959f6e9c41cca690b9dedd537568 P c5f9d1717edc41209ab8ed56702e13ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 887dc57e6fcd4c4fa6ef7f208b093ddf in term 1.
I20260809 02:19:40.471829 19250 raft_consensus.cc:2454] T 88a9959f6e9c41cca690b9dedd537568 P ddbaeb0e974f4cb98ce1bb675b60e5c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 887dc57e6fcd4c4fa6ef7f208b093ddf in term 1.
I20260809 02:19:40.471976 19325 leader_election.cc:302] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 887dc57e6fcd4c4fa6ef7f208b093ddf, c5f9d1717edc41209ab8ed56702e13ba; no voters:
I20260809 02:19:40.472090 19492 raft_consensus.cc:2781] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:40.472268 19492 raft_consensus.cc:686] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf [term 1 LEADER]: Becoming Leader. State: Replica: 887dc57e6fcd4c4fa6ef7f208b093ddf, State: Running, Role: LEADER
I20260809 02:19:40.472563 19492 consensus_queue.cc:237] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f9d1717edc41209ab8ed56702e13ba" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35047 } } peers { permanent_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 42749 } } peers { permanent_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37587 } }
I20260809 02:19:40.473439 18138 catalog_manager.cc:5495] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf reported cstate change: term changed from 0 to 1, leader changed from <none> to 887dc57e6fcd4c4fa6ef7f208b093ddf (127.11.93.131). New cstate: current_term: 1 leader_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f9d1717edc41209ab8ed56702e13ba" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 42749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37587 } health_report { overall_health: HEALTHY } } }
W20260809 02:19:40.481349 19450 tablet.cc:2369] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:19:40.491110 19480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.488776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33838 (local address 127.11.93.131:37587)
0809 02:19:40.488829 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:40.488831 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:40.488842 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:19:40.488892 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:40.488892 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:40.488909 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:40.488983 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:19:40.489125 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.489592 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.490318 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.490511 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.490582 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.490754 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:19:40.490846 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:19:40.490951 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:40.491007 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 02:19:40.491028 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 02:19:40.492797 19250 raft_consensus.cc:1261] T 88a9959f6e9c41cca690b9dedd537568 P ddbaeb0e974f4cb98ce1bb675b60e5c9 [term 1 FOLLOWER]: Refusing update from remote peer 887dc57e6fcd4c4fa6ef7f208b093ddf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:40.492816 19108 raft_consensus.cc:1261] T 88a9959f6e9c41cca690b9dedd537568 P c5f9d1717edc41209ab8ed56702e13ba [term 1 FOLLOWER]: Refusing update from remote peer 887dc57e6fcd4c4fa6ef7f208b093ddf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:40.493126 19492 consensus_queue.cc:1035] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:40.493283 19493 consensus_queue.cc:1035] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f9d1717edc41209ab8ed56702e13ba" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:40.496361 19496 mvcc.cc:205] Tried to move back new op lower bound from 7316447152095928320 to 7316447152016347136. Current Snapshot: MvccSnapshot[applied={T|T < 7316447152095928320 or (T in {7316447152095928320})}]
I20260809 02:19:40.496589 19498 mvcc.cc:205] Tried to move back new op lower bound from 7316447152095928320 to 7316447152016347136. Current Snapshot: MvccSnapshot[applied={T|T < 7316447152095928320}]
I20260809 02:19:40.498106 18140 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:40.498191 18140 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:40.499790 18140 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 112dec87977444b9a74941e09be89dea: Sending DeleteTablet for 3 replicas of tablet 88a9959f6e9c41cca690b9dedd537568
I20260809 02:19:40.500147 19228 tablet_service.cc:1514] Processing DeleteTablet for tablet 88a9959f6e9c41cca690b9dedd537568 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:40 UTC) from {username='oryx', principal='oryx/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:33132
I20260809 02:19:40.500309 19375 tablet_service.cc:1514] Processing DeleteTablet for tablet 88a9959f6e9c41cca690b9dedd537568 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:40 UTC) from {username='oryx', principal='oryx/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:33832
I20260809 02:19:40.500370 19088 tablet_service.cc:1514] Processing DeleteTablet for tablet 88a9959f6e9c41cca690b9dedd537568 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:40 UTC) from {username='oryx', principal='oryx/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:34616
I20260809 02:19:40.500556 19508 tablet_replica.cc:330] T 88a9959f6e9c41cca690b9dedd537568 P c5f9d1717edc41209ab8ed56702e13ba: stopping tablet replica
I20260809 02:19:40.500923 19507 tablet_replica.cc:330] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf: stopping tablet replica
I20260809 02:19:40.500960 19508 raft_consensus.cc:2229] T 88a9959f6e9c41cca690b9dedd537568 P c5f9d1717edc41209ab8ed56702e13ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:40.501019 19507 raft_consensus.cc:2229] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:19:40.501063 19508 raft_consensus.cc:2258] T 88a9959f6e9c41cca690b9dedd537568 P c5f9d1717edc41209ab8ed56702e13ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:40.501109 19507 raft_consensus.cc:2258] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:40.501441 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 18108
I20260809 02:19:40.501662 19508 ts_tablet_manager.cc:1905] T 88a9959f6e9c41cca690b9dedd537568 P c5f9d1717edc41209ab8ed56702e13ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:40.501659 19507 ts_tablet_manager.cc:1905] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:40.503856 19507 ts_tablet_manager.cc:1918] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:19:40.503934 19507 log.cc:1196] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/88a9959f6e9c41cca690b9dedd537568
I20260809 02:19:40.504211 19507 ts_tablet_manager.cc:1939] T 88a9959f6e9c41cca690b9dedd537568 P 887dc57e6fcd4c4fa6ef7f208b093ddf: Deleting consensus metadata
I20260809 02:19:40.505160 19508 ts_tablet_manager.cc:1918] T 88a9959f6e9c41cca690b9dedd537568 P c5f9d1717edc41209ab8ed56702e13ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:19:40.505254 19508 log.cc:1196] T 88a9959f6e9c41cca690b9dedd537568 P c5f9d1717edc41209ab8ed56702e13ba: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-0/wal/wals/88a9959f6e9c41cca690b9dedd537568
I20260809 02:19:40.505492 19508 ts_tablet_manager.cc:1939] T 88a9959f6e9c41cca690b9dedd537568 P c5f9d1717edc41209ab8ed56702e13ba: Deleting consensus metadata
I20260809 02:19:40.505894 19506 tablet_replica.cc:330] T 88a9959f6e9c41cca690b9dedd537568 P ddbaeb0e974f4cb98ce1bb675b60e5c9: stopping tablet replica
I20260809 02:19:40.506023 19506 raft_consensus.cc:2229] T 88a9959f6e9c41cca690b9dedd537568 P ddbaeb0e974f4cb98ce1bb675b60e5c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:40.506139 19506 raft_consensus.cc:2258] T 88a9959f6e9c41cca690b9dedd537568 P ddbaeb0e974f4cb98ce1bb675b60e5c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:40.506543 19506 ts_tablet_manager.cc:1905] T 88a9959f6e9c41cca690b9dedd537568 P ddbaeb0e974f4cb98ce1bb675b60e5c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:40.508152 19506 ts_tablet_manager.cc:1918] T 88a9959f6e9c41cca690b9dedd537568 P ddbaeb0e974f4cb98ce1bb675b60e5c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:19:40.508240 19506 log.cc:1196] T 88a9959f6e9c41cca690b9dedd537568 P ddbaeb0e974f4cb98ce1bb675b60e5c9: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/88a9959f6e9c41cca690b9dedd537568
I20260809 02:19:40.508514 19506 ts_tablet_manager.cc:1939] T 88a9959f6e9c41cca690b9dedd537568 P ddbaeb0e974f4cb98ce1bb675b60e5c9: Deleting consensus metadata
W20260809 02:19:40.511874 19183 connection.cc:535] server connection from 127.0.0.1:33132 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 02:19:40.511907 19327 connection.cc:535] server connection from 127.0.0.1:33832 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 02:19:40.512281 19042 connection.cc:535] server connection from 127.0.0.1:34616 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 02:19:40.521487 19462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.513839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49806 (local address 127.11.93.188:34943)
0809 02:19:40.513875 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:40.513877 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:40.513962 (+ 85us) server_negotiation.cc:407] Connection header received
0809 02:19:40.514074 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:40.514075 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:40.514090 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:40.514141 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:40.514688 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.515497 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.516577 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.516812 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.516865 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.518448 (+ 1583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:40.518449 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:40.518450 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:40.518457 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:40.520269 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:40.520646 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:40.520647 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:40.520648 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:40.520707 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:40.520889 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:40.520890 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:40.520890 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:40.521025 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:40.521125 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:40.521232 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 02:19:40.521316 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 02:19:40.521771 19458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:40.513684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49052 (local address 127.11.93.189:41047)
0809 02:19:40.513731 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:40.513733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:40.513929 (+ 196us) server_negotiation.cc:407] Connection header received
0809 02:19:40.514017 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:40.514018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:40.514032 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:40.514093 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:40.514846 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.515585 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.516285 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:40.516509 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:40.516588 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:40.518312 (+ 1724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:40.518313 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:40.518314 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:40.518321 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:40.520112 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:40.520699 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:40.520700 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:40.520701 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:40.520756 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:40.520939 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:40.520940 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:40.520941 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:40.521087 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:40.521179 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:40.521589 (+ 410us) server_negotiation.cc:299] Negotiation successful
0809 02:19:40.521676 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 02:19:41.497433 19517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:41.497057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.130:41781)
0809 02:19:41.497293 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:41.497384 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":64,"threads_started":1}
W20260809 02:19:41.497722 19301 heartbeater.cc:644] Failed to heartbeat to 127.11.93.190:34587 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
I20260809 02:19:41.499356 19518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:41.499106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.131:36145)
0809 02:19:41.499212 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:41.499318 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":65,"threads_started":1}
W20260809 02:19:41.499555 19447 heartbeater.cc:644] Failed to heartbeat to 127.11.93.190:34587 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
I20260809 02:19:41.501360 19519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:41.501171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.129:42181)
0809 02:19:41.501276 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:41.501326 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":43,"threads_started":1}
W20260809 02:19:41.501538 19156 heartbeater.cc:644] Failed to heartbeat to 127.11.93.190:34587 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
I20260809 02:19:42.000213 19520 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 112dec87977444b9a74941e09be89dea)
I20260809 02:19:42.000428 19521 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 112dec87977444b9a74941e09be89dea)
I20260809 02:19:42.000437 19520 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: false } }
I20260809 02:19:42.000542 19521 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: false } }
I20260809 02:19:42.000988 19521 leader_election.cc:288] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 112dec87977444b9a74941e09be89dea (127.11.93.190:34587), 5ab97c7a07b64751b8dead417fea62a8 (127.11.93.189:41047)
I20260809 02:19:42.001003 19520 leader_election.cc:288] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 112dec87977444b9a74941e09be89dea (127.11.93.190:34587), bc09e44584e24b83bbbe6f6998fae662 (127.11.93.188:34943)
I20260809 02:19:42.001121 19522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:42.000897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.0.0.1:45818)
0809 02:19:42.001019 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:42.001069 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":59,"threads_started":1}
I20260809 02:19:42.001434 19523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:42.001194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.0.0.1:45830)
0809 02:19:42.001319 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:42.001373 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":60,"threads_started":1}
W20260809 02:19:42.001425 18956 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
W20260809 02:19:42.001704 18763 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
I20260809 02:19:42.001983 19522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:42.001864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.0.0.1:45834)
0809 02:19:42.001899 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:42.001923 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260809 02:19:42.002058 18956 leader_election.cc:334] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 112dec87977444b9a74941e09be89dea (127.11.93.190:34587): Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
I20260809 02:19:42.002411 19523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:42.002319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.0.0.1:45846)
0809 02:19:42.002351 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:42.002387 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260809 02:19:42.002532 18763 leader_election.cc:334] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 112dec87977444b9a74941e09be89dea (127.11.93.190:34587): Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
I20260809 02:19:42.004370 19525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:42.001159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49066 (local address 127.11.93.189:41047)
0809 02:19:42.001360 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:42.001361 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:42.001369 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:19:42.001393 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:42.001394 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:42.001403 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:42.001641 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:42.001680 (+ 39us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:42.002450 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:42.003601 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:42.004046 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:42.004124 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:42.004136 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:42.004270 (+ 134us) server_negotiation.cc:299] Negotiation successful
0809 02:19:42.004309 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":47,"threads_started":1}
I20260809 02:19:42.004372 19524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:42.000903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:41047 (local address 127.0.0.1:49066)
0809 02:19:42.001128 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:42.001140 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:42.001220 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:42.001499 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:42.001500 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:42.001504 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:42.001574 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:42.001576 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:42.002553 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:42.002554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:42.003501 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:42.003504 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:42.004124 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:42.004125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:42.004189 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:42.004193 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:19:42.004263 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 02:19:42.004305 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":49,"threads_started":1}
I20260809 02:19:42.004457 19526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:42.000908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:34943 (local address 127.0.0.1:49812)
0809 02:19:42.001326 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:42.001338 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:42.001395 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:42.001648 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:42.001648 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:42.001650 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:42.001735 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:42.001737 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:42.002660 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:42.002661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:42.003656 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:42.003659 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:42.004204 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:42.004205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:42.004268 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:42.004271 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:19:42.004341 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 02:19:42.004386 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":50,"threads_started":1}
I20260809 02:19:42.004694 19527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:42.001258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49812 (local address 127.11.93.188:34943)
0809 02:19:42.001499 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:42.001501 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:42.001509 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:19:42.001532 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:42.001533 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:42.001544 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:42.001806 (+ 262us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:42.001841 (+ 35us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:42.002589 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:42.003737 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:42.004123 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:42.004202 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:42.004213 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:42.004348 (+ 135us) server_negotiation.cc:299] Negotiation successful
0809 02:19:42.004390 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":54,"threads_started":1}
I20260809 02:19:42.004721 18787 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bc09e44584e24b83bbbe6f6998fae662" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5ab97c7a07b64751b8dead417fea62a8" is_pre_election: true
I20260809 02:19:42.004819 18787 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc09e44584e24b83bbbe6f6998fae662 in term 1.
I20260809 02:19:42.004884 18979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5ab97c7a07b64751b8dead417fea62a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "bc09e44584e24b83bbbe6f6998fae662" is_pre_election: true
I20260809 02:19:42.004973 18954 leader_election.cc:302] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ab97c7a07b64751b8dead417fea62a8, bc09e44584e24b83bbbe6f6998fae662; no voters: 112dec87977444b9a74941e09be89dea
I20260809 02:19:42.004993 18979 raft_consensus.cc:2454] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ab97c7a07b64751b8dead417fea62a8 in term 1.
I20260809 02:19:42.005075 19521 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 02:19:42.005123 19521 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 112dec87977444b9a74941e09be89dea)
I20260809 02:19:42.005131 18761 leader_election.cc:302] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ab97c7a07b64751b8dead417fea62a8, bc09e44584e24b83bbbe6f6998fae662; no voters: 112dec87977444b9a74941e09be89dea
I20260809 02:19:42.005154 19521 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 1 FOLLOWER]: Advancing to term 2
I20260809 02:19:42.005242 19520 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 02:19:42.005282 19520 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 112dec87977444b9a74941e09be89dea)
I20260809 02:19:42.005304 19520 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 1 FOLLOWER]: Advancing to term 2
I20260809 02:19:42.005910 19521 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: false } }
I20260809 02:19:42.005954 19520 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: false } }
I20260809 02:19:42.006052 19521 leader_election.cc:288] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [CANDIDATE]: Term 2 election: Requested vote from peers 112dec87977444b9a74941e09be89dea (127.11.93.190:34587), 5ab97c7a07b64751b8dead417fea62a8 (127.11.93.189:41047)
I20260809 02:19:42.006209 18787 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bc09e44584e24b83bbbe6f6998fae662" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5ab97c7a07b64751b8dead417fea62a8"
I20260809 02:19:42.006248 19520 leader_election.cc:288] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [CANDIDATE]: Term 2 election: Requested vote from peers 112dec87977444b9a74941e09be89dea (127.11.93.190:34587), bc09e44584e24b83bbbe6f6998fae662 (127.11.93.188:34943)
I20260809 02:19:42.006315 18787 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bc09e44584e24b83bbbe6f6998fae662 in current term 2: Already voted for candidate 5ab97c7a07b64751b8dead417fea62a8 in this term.
I20260809 02:19:42.006220 19524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:42.006121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.0.0.1:45856)
0809 02:19:42.006165 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:42.006194 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260809 02:19:42.006371 18979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5ab97c7a07b64751b8dead417fea62a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "bc09e44584e24b83bbbe6f6998fae662"
I20260809 02:19:42.006282 19526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:42.006143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.0.0.1:45862)
0809 02:19:42.006182 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:42.006201 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260809 02:19:42.006460 18979 raft_consensus.cc:2379] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ab97c7a07b64751b8dead417fea62a8 in current term 2: Already voted for candidate bc09e44584e24b83bbbe6f6998fae662 in this term.
I20260809 02:19:42.006681 19524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:42.006537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.0.0.1:45868)
0809 02:19:42.006593 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:42.006652 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 02:19:42.006778 18956 leader_election.cc:334] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 112dec87977444b9a74941e09be89dea (127.11.93.190:34587): Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
I20260809 02:19:42.006835 19526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:42.006756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.0.0.1:45870)
0809 02:19:42.006790 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:42.006812 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260809 02:19:42.006832 18956 leader_election.cc:302] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc09e44584e24b83bbbe6f6998fae662; no voters: 112dec87977444b9a74941e09be89dea, 5ab97c7a07b64751b8dead417fea62a8
W20260809 02:19:42.006896 18763 leader_election.cc:334] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 112dec87977444b9a74941e09be89dea (127.11.93.190:34587): Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
I20260809 02:19:42.006928 19521 raft_consensus.cc:2726] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260809 02:19:42.006937 18763 leader_election.cc:302] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ab97c7a07b64751b8dead417fea62a8; no voters: 112dec87977444b9a74941e09be89dea, bc09e44584e24b83bbbe6f6998fae662
I20260809 02:19:42.007047 19520 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260809 02:19:42.498402 19531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:42.498109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.130:45349)
0809 02:19:42.498283 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:42.498332 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":108,"threads_started":1}
I20260809 02:19:42.500056 19532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:42.499823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.131:34169)
0809 02:19:42.499960 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:42.499992 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":103,"threads_started":1}
I20260809 02:19:42.502029 19533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:42.501793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.129:48621)
0809 02:19:42.501949 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:42.501987 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":74,"threads_started":1}
I20260809 02:19:43.499171 19534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.498909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.130:37199)
0809 02:19:43.499048 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.499096 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":110,"threads_started":1}
I20260809 02:19:43.500684 19535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.500493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.131:48589)
0809 02:19:43.500605 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.500637 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":60,"threads_started":1}
I20260809 02:19:43.502527 19536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.502368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.129:41629)
0809 02:19:43.502457 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.502491 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74,"thread_start_us":48,"threads_started":1}
I20260809 02:19:43.528947 19537 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:19:43.529050 19537 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: false } }
I20260809 02:19:43.529213 19537 leader_election.cc:288] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 112dec87977444b9a74941e09be89dea (127.11.93.190:34587), bc09e44584e24b83bbbe6f6998fae662 (127.11.93.188:34943)
I20260809 02:19:43.529472 18979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5ab97c7a07b64751b8dead417fea62a8" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "bc09e44584e24b83bbbe6f6998fae662" is_pre_election: true
I20260809 02:19:43.529583 19538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.529352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.0.0.1:46088)
0809 02:19:43.529482 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.529533 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":61,"threads_started":1}
I20260809 02:19:43.529600 18979 raft_consensus.cc:2454] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ab97c7a07b64751b8dead417fea62a8 in term 2.
I20260809 02:19:43.529798 18761 leader_election.cc:302] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ab97c7a07b64751b8dead417fea62a8, bc09e44584e24b83bbbe6f6998fae662; no voters:
I20260809 02:19:43.529915 19537 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260809 02:19:43.529970 19537 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:19:43.529995 19537 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 2 FOLLOWER]: Advancing to term 3
I20260809 02:19:43.530215 19538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.529957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.0.0.1:46098)
0809 02:19:43.530098 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.530137 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
W20260809 02:19:43.530335 18763 leader_election.cc:334] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 112dec87977444b9a74941e09be89dea (127.11.93.190:34587): Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
I20260809 02:19:43.530846 19537 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: false } }
I20260809 02:19:43.530978 19537 leader_election.cc:288] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [CANDIDATE]: Term 3 election: Requested vote from peers 112dec87977444b9a74941e09be89dea (127.11.93.190:34587), bc09e44584e24b83bbbe6f6998fae662 (127.11.93.188:34943)
I20260809 02:19:43.531193 19538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.531064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.0.0.1:46106)
0809 02:19:43.531124 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.531161 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260809 02:19:43.531227 18979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5ab97c7a07b64751b8dead417fea62a8" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "bc09e44584e24b83bbbe6f6998fae662"
I20260809 02:19:43.531306 18979 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 2 FOLLOWER]: Advancing to term 3
I20260809 02:19:43.531529 19538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.531452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.0.0.1:46118)
0809 02:19:43.531489 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.531515 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260809 02:19:43.531625 18763 leader_election.cc:334] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 112dec87977444b9a74941e09be89dea (127.11.93.190:34587): Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
I20260809 02:19:43.532089 18979 raft_consensus.cc:2454] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ab97c7a07b64751b8dead417fea62a8 in term 3.
I20260809 02:19:43.532343 18761 leader_election.cc:302] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ab97c7a07b64751b8dead417fea62a8, bc09e44584e24b83bbbe6f6998fae662; no voters: 112dec87977444b9a74941e09be89dea
I20260809 02:19:43.532454 19537 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 02:19:43.532583 19537 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [term 3 LEADER]: Becoming Leader. State: Replica: 5ab97c7a07b64751b8dead417fea62a8, State: Running, Role: LEADER
I20260809 02:19:43.532662 19537 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: false } }
I20260809 02:19:43.533057 19540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ab97c7a07b64751b8dead417fea62a8. Latest consensus state: current_term: 3 leader_uuid: "5ab97c7a07b64751b8dead417fea62a8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: false } } }
I20260809 02:19:43.533179 19540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:43.533407 19542 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:19:43.533915 19542 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:19:43.534003 19542 catalog_manager.cc:1259] Loaded cluster ID: 89ee773d252f4feeaa259289ca4934c0
I20260809 02:19:43.534037 19542 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:19:43.534227 19542 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:19:43.534325 19542 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8: Loaded TSK: 0
I20260809 02:19:43.534468 19542 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:19:43.605068 18775 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49052:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:19:43.606720 18775 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:19:43.607911 19538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.607793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.0.0.1:46140)
0809 02:19:43.607849 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.607879 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 02:19:43.607952 18979 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [term 3 FOLLOWER]: Refusing update from remote peer 5ab97c7a07b64751b8dead417fea62a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260809 02:19:43.608301 19538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.608219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.0.0.1:46144)
0809 02:19:43.608250 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.608274 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260809 02:19:43.608310 19540 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260809 02:19:43.608467 18763 consensus_peers.cc:487] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 -> Peer 112dec87977444b9a74941e09be89dea (127.11.93.190:34587): Couldn't send request to peer 112dec87977444b9a74941e09be89dea. Status: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 02:19:43.609061 19544 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ab97c7a07b64751b8dead417fea62a8. Latest consensus state: current_term: 3 leader_uuid: "5ab97c7a07b64751b8dead417fea62a8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: false } } }
I20260809 02:19:43.609169 19544 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:19:43.609655 19540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "5ab97c7a07b64751b8dead417fea62a8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: false } } }
I20260809 02:19:43.609745 19540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8 [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:43.609869 19544 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "5ab97c7a07b64751b8dead417fea62a8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "112dec87977444b9a74941e09be89dea" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 34587 } } peers { permanent_uuid: "5ab97c7a07b64751b8dead417fea62a8" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 41047 } attrs { promote: false } } peers { permanent_uuid: "bc09e44584e24b83bbbe6f6998fae662" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 34943 } attrs { promote: false } } }
I20260809 02:19:43.609963 19544 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc09e44584e24b83bbbe6f6998fae662 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:19:43.615185 19550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.611633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34618 (local address 127.11.93.129:35047)
0809 02:19:43.611966 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:43.611967 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:43.611975 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:19:43.612002 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:43.612003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:43.612014 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:43.612256 (+ 242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:43.612295 (+ 39us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:43.612824 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:43.614231 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:43.614811 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:43.614886 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:43.614896 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:43.615057 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 02:19:43.615102 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":70,"threads_started":1}
I20260809 02:19:43.615192 19538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.611554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:35047 (local address 127.0.0.1:34618)
0809 02:19:43.611739 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.611750 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:43.611802 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:43.612104 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:43.612105 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:43.612107 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:43.612187 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:43.612189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:43.612902 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:43.612903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:43.614160 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:43.614164 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:43.614895 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:43.614896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:43.614955 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:43.614960 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:19:43.615048 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 02:19:43.615098 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"mutex_wait_us":58}
I20260809 02:19:43.615428 19552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.611649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:42749 (local address 127.0.0.1:33140)
0809 02:19:43.612000 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.612009 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:43.612049 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:43.612503 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:43.612503 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:43.612505 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:43.612539 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:43.612541 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:43.613508 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:43.613509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:43.614501 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:43.614503 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:43.615167 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:43.615168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:43.615249 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:43.615252 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:19:43.615304 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 02:19:43.615360 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":122,"threads_started":1}
I20260809 02:19:43.615499 19088 tablet_service.cc:1467] Processing CreateTablet for tablet 13f52fc9077849079f8c0f1a5526781e (DEFAULT_TABLE table=test-table [id=7aad07c3f83041a89f1e7df3b45c7ecb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:43.615646 19088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13f52fc9077849079f8c0f1a5526781e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:43.615648 19553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.611723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33140 (local address 127.11.93.130:42749)
0809 02:19:43.612334 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:43.612336 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:43.612344 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:19:43.612369 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:43.612369 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:43.612379 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:43.612466 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:43.612606 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:43.613420 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:43.614577 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:43.615067 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:43.615124 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:43.615135 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:43.615515 (+ 380us) server_negotiation.cc:299] Negotiation successful
0809 02:19:43.615565 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":51,"threads_started":1}
I20260809 02:19:43.615746 19554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.611817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33842 (local address 127.11.93.131:37587)
0809 02:19:43.611963 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:43.611965 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:43.611974 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:19:43.612001 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:43.612002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:43.612015 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:43.612068 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:43.612270 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:43.613008 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:43.614256 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:43.614824 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:43.614884 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:43.614896 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:43.615600 (+ 704us) server_negotiation.cc:299] Negotiation successful
0809 02:19:43.615654 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":59,"threads_started":1}
I20260809 02:19:43.616858 19555 tablet_bootstrap.cc:492] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba: Bootstrap starting.
I20260809 02:19:43.615211 19551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.611648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:37587 (local address 127.0.0.1:33842)
0809 02:19:43.611823 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.611833 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:43.611901 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:43.612154 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:43.612155 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:43.612157 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:43.612209 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:43.612211 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:43.613101 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:43.613102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:43.614152 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:43.614154 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:43.614930 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:43.614931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:43.615013 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:43.615018 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:19:43.615068 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 02:19:43.615109 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":3,"thread_start_us":80,"threads_started":1}
I20260809 02:19:43.617076 19228 tablet_service.cc:1467] Processing CreateTablet for tablet 13f52fc9077849079f8c0f1a5526781e (DEFAULT_TABLE table=test-table [id=7aad07c3f83041a89f1e7df3b45c7ecb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:43.617188 19228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13f52fc9077849079f8c0f1a5526781e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:43.617233 19375 tablet_service.cc:1467] Processing CreateTablet for tablet 13f52fc9077849079f8c0f1a5526781e (DEFAULT_TABLE table=test-table [id=7aad07c3f83041a89f1e7df3b45c7ecb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:43.617353 19375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13f52fc9077849079f8c0f1a5526781e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:43.617589 19555 tablet_bootstrap.cc:654] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:43.618350 19555 tablet_bootstrap.cc:492] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba: No bootstrap required, opened a new log
I20260809 02:19:43.618392 19555 ts_tablet_manager.cc:1397] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:19:43.618580 19557 tablet_bootstrap.cc:492] T 13f52fc9077849079f8c0f1a5526781e P 887dc57e6fcd4c4fa6ef7f208b093ddf: Bootstrap starting.
I20260809 02:19:43.618553 19555 raft_consensus.cc:348] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f9d1717edc41209ab8ed56702e13ba" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35047 } } peers { permanent_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 42749 } } peers { permanent_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37587 } }
I20260809 02:19:43.618646 19555 raft_consensus.cc:374] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:43.618669 19555 raft_consensus.cc:729] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f9d1717edc41209ab8ed56702e13ba, State: Initialized, Role: FOLLOWER
I20260809 02:19:43.618727 19555 consensus_queue.cc:260] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f9d1717edc41209ab8ed56702e13ba" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35047 } } peers { permanent_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 42749 } } peers { permanent_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37587 } }
I20260809 02:19:43.618922 19555 ts_tablet_manager.cc:1428] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 02:19:43.618952 19558 tablet_bootstrap.cc:492] T 13f52fc9077849079f8c0f1a5526781e P ddbaeb0e974f4cb98ce1bb675b60e5c9: Bootstrap starting.
I20260809 02:19:43.619254 19536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.619152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.129:36759)
0809 02:19:43.619196 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.619221 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260809 02:19:43.619346 19558 tablet_bootstrap.cc:654] T 13f52fc9077849079f8c0f1a5526781e P ddbaeb0e974f4cb98ce1bb675b60e5c9: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:43.619839 19536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.619745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.129:35853)
0809 02:19:43.619780 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.619801 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260809 02:19:43.619928 19159 heartbeater.cc:503] Master 127.11.93.189:41047 was elected leader, sending a full tablet report...
I20260809 02:19:43.620009 19557 tablet_bootstrap.cc:654] T 13f52fc9077849079f8c0f1a5526781e P 887dc57e6fcd4c4fa6ef7f208b093ddf: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:43.620334 19558 tablet_bootstrap.cc:492] T 13f52fc9077849079f8c0f1a5526781e P ddbaeb0e974f4cb98ce1bb675b60e5c9: No bootstrap required, opened a new log
I20260809 02:19:43.620388 19558 ts_tablet_manager.cc:1397] T 13f52fc9077849079f8c0f1a5526781e P ddbaeb0e974f4cb98ce1bb675b60e5c9: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 02:19:43.620523 19558 raft_consensus.cc:348] T 13f52fc9077849079f8c0f1a5526781e P ddbaeb0e974f4cb98ce1bb675b60e5c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f9d1717edc41209ab8ed56702e13ba" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35047 } } peers { permanent_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 42749 } } peers { permanent_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37587 } }
I20260809 02:19:43.620604 19558 raft_consensus.cc:374] T 13f52fc9077849079f8c0f1a5526781e P ddbaeb0e974f4cb98ce1bb675b60e5c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:43.620627 19558 raft_consensus.cc:729] T 13f52fc9077849079f8c0f1a5526781e P ddbaeb0e974f4cb98ce1bb675b60e5c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddbaeb0e974f4cb98ce1bb675b60e5c9, State: Initialized, Role: FOLLOWER
I20260809 02:19:43.620639 19557 tablet_bootstrap.cc:492] T 13f52fc9077849079f8c0f1a5526781e P 887dc57e6fcd4c4fa6ef7f208b093ddf: No bootstrap required, opened a new log
I20260809 02:19:43.620692 19557 ts_tablet_manager.cc:1397] T 13f52fc9077849079f8c0f1a5526781e P 887dc57e6fcd4c4fa6ef7f208b093ddf: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 02:19:43.620687 19558 consensus_queue.cc:260] T 13f52fc9077849079f8c0f1a5526781e P ddbaeb0e974f4cb98ce1bb675b60e5c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f9d1717edc41209ab8ed56702e13ba" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35047 } } peers { permanent_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 42749 } } peers { permanent_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37587 } }
I20260809 02:19:43.620831 19557 raft_consensus.cc:348] T 13f52fc9077849079f8c0f1a5526781e P 887dc57e6fcd4c4fa6ef7f208b093ddf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f9d1717edc41209ab8ed56702e13ba" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35047 } } peers { permanent_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 42749 } } peers { permanent_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37587 } }
I20260809 02:19:43.620890 19558 ts_tablet_manager.cc:1428] T 13f52fc9077849079f8c0f1a5526781e P ddbaeb0e974f4cb98ce1bb675b60e5c9: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:43.620923 19557 raft_consensus.cc:374] T 13f52fc9077849079f8c0f1a5526781e P 887dc57e6fcd4c4fa6ef7f208b093ddf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:43.620947 19557 raft_consensus.cc:729] T 13f52fc9077849079f8c0f1a5526781e P 887dc57e6fcd4c4fa6ef7f208b093ddf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 887dc57e6fcd4c4fa6ef7f208b093ddf, State: Initialized, Role: FOLLOWER
I20260809 02:19:43.621012 19557 consensus_queue.cc:260] T 13f52fc9077849079f8c0f1a5526781e P 887dc57e6fcd4c4fa6ef7f208b093ddf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f9d1717edc41209ab8ed56702e13ba" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35047 } } peers { permanent_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 42749 } } peers { permanent_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37587 } }
I20260809 02:19:43.621127 19534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.621015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.130:40413)
0809 02:19:43.621065 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.621097 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 02:19:43.621187 19557 ts_tablet_manager.cc:1428] T 13f52fc9077849079f8c0f1a5526781e P 887dc57e6fcd4c4fa6ef7f208b093ddf: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:43.621531 19535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.621435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.131:34389)
0809 02:19:43.621478 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.621503 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260809 02:19:43.621699 19303 heartbeater.cc:503] Master 127.11.93.189:41047 was elected leader, sending a full tablet report...
I20260809 02:19:43.621961 19534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.621883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.130:40431)
0809 02:19:43.621918 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.621940 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260809 02:19:43.697130 19559 raft_consensus.cc:482] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:19:43.697237 19559 raft_consensus.cc:504] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f9d1717edc41209ab8ed56702e13ba" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35047 } } peers { permanent_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 42749 } } peers { permanent_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37587 } }
I20260809 02:19:43.697571 19559 leader_election.cc:288] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddbaeb0e974f4cb98ce1bb675b60e5c9 (127.11.93.130:42749), 887dc57e6fcd4c4fa6ef7f208b093ddf (127.11.93.131:37587)
I20260809 02:19:43.701826 19553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.697854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:34253 (local address 127.11.93.130:42749)
0809 02:19:43.697924 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:43.697926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:43.697955 (+ 29us) server_negotiation.cc:407] Connection header received
0809 02:19:43.697984 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:43.697985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:43.697995 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:43.698048 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:43.698363 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:43.699152 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:43.700875 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:43.701451 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:43.701516 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:43.701526 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:43.701709 (+ 183us) server_negotiation.cc:299] Negotiation successful
0809 02:19:43.701750 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:19:43.701858 19554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.697851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:38187 (local address 127.11.93.131:37587)
0809 02:19:43.697928 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:43.697930 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:43.698266 (+ 336us) server_negotiation.cc:407] Connection header received
0809 02:19:43.698367 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:43.698368 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:43.698379 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:43.698435 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:43.698571 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:43.699295 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:43.700875 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:43.701441 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:43.701516 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:43.701526 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:43.701709 (+ 183us) server_negotiation.cc:299] Negotiation successful
0809 02:19:43.701769 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:19:43.701890 19536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.697743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:42749 (local address 127.11.93.129:34253)
0809 02:19:43.697805 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.697850 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:43.697918 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:43.698068 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:43.698070 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:43.698074 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:43.698197 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:43.698200 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:43.699272 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:43.699273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:43.700773 (+ 1500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:43.700776 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:43.701553 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:43.701553 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:43.701627 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:43.701630 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:19:43.701694 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 02:19:43.701746 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":33}
I20260809 02:19:43.701900 19564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.697742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:37587 (local address 127.11.93.129:38187)
0809 02:19:43.698171 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.698183 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:43.698265 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:43.698449 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:43.698450 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:43.698451 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:43.698503 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:43.698504 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:43.699361 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:43.699362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:43.700773 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:43.700776 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:43.701528 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:43.701530 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:43.701617 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:43.701622 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:19:43.701694 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 02:19:43.701754 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"mutex_wait_us":231,"thread_start_us":121,"threads_started":1}
I20260809 02:19:43.702176 19250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13f52fc9077849079f8c0f1a5526781e" candidate_uuid: "c5f9d1717edc41209ab8ed56702e13ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" is_pre_election: true
I20260809 02:19:43.702343 19250 raft_consensus.cc:2454] T 13f52fc9077849079f8c0f1a5526781e P ddbaeb0e974f4cb98ce1bb675b60e5c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f9d1717edc41209ab8ed56702e13ba in term 0.
I20260809 02:19:43.702418 19397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13f52fc9077849079f8c0f1a5526781e" candidate_uuid: "c5f9d1717edc41209ab8ed56702e13ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" is_pre_election: true
I20260809 02:19:43.702584 19397 raft_consensus.cc:2454] T 13f52fc9077849079f8c0f1a5526781e P 887dc57e6fcd4c4fa6ef7f208b093ddf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f9d1717edc41209ab8ed56702e13ba in term 0.
I20260809 02:19:43.702603 19039 leader_election.cc:302] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f9d1717edc41209ab8ed56702e13ba, ddbaeb0e974f4cb98ce1bb675b60e5c9; no voters:
I20260809 02:19:43.702768 19559 raft_consensus.cc:2781] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:19:43.702816 19559 raft_consensus.cc:482] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:19:43.702841 19559 raft_consensus.cc:3037] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:43.703922 19559 raft_consensus.cc:504] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f9d1717edc41209ab8ed56702e13ba" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35047 } } peers { permanent_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 42749 } } peers { permanent_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37587 } }
I20260809 02:19:43.704077 19559 leader_election.cc:288] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba [CANDIDATE]: Term 1 election: Requested vote from peers ddbaeb0e974f4cb98ce1bb675b60e5c9 (127.11.93.130:42749), 887dc57e6fcd4c4fa6ef7f208b093ddf (127.11.93.131:37587)
I20260809 02:19:43.704257 19250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13f52fc9077849079f8c0f1a5526781e" candidate_uuid: "c5f9d1717edc41209ab8ed56702e13ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9"
I20260809 02:19:43.704269 19397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13f52fc9077849079f8c0f1a5526781e" candidate_uuid: "c5f9d1717edc41209ab8ed56702e13ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf"
I20260809 02:19:43.704344 19397 raft_consensus.cc:3037] T 13f52fc9077849079f8c0f1a5526781e P 887dc57e6fcd4c4fa6ef7f208b093ddf [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:43.704344 19250 raft_consensus.cc:3037] T 13f52fc9077849079f8c0f1a5526781e P ddbaeb0e974f4cb98ce1bb675b60e5c9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:43.705165 19250 raft_consensus.cc:2454] T 13f52fc9077849079f8c0f1a5526781e P ddbaeb0e974f4cb98ce1bb675b60e5c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f9d1717edc41209ab8ed56702e13ba in term 1.
I20260809 02:19:43.705229 19397 raft_consensus.cc:2454] T 13f52fc9077849079f8c0f1a5526781e P 887dc57e6fcd4c4fa6ef7f208b093ddf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f9d1717edc41209ab8ed56702e13ba in term 1.
I20260809 02:19:43.705394 19042 leader_election.cc:302] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 887dc57e6fcd4c4fa6ef7f208b093ddf, c5f9d1717edc41209ab8ed56702e13ba; no voters:
I20260809 02:19:43.705538 19559 raft_consensus.cc:2781] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:43.705737 19559 raft_consensus.cc:686] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba [term 1 LEADER]: Becoming Leader. State: Replica: c5f9d1717edc41209ab8ed56702e13ba, State: Running, Role: LEADER
I20260809 02:19:43.705798 19559 consensus_queue.cc:237] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f9d1717edc41209ab8ed56702e13ba" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35047 } } peers { permanent_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 42749 } } peers { permanent_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37587 } }
I20260809 02:19:43.706085 19564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.705977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.129:37131)
0809 02:19:43.706013 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.706050 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260809 02:19:43.706578 18775 catalog_manager.cc:5495] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f9d1717edc41209ab8ed56702e13ba (127.11.93.129). New cstate: current_term: 1 leader_uuid: "c5f9d1717edc41209ab8ed56702e13ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f9d1717edc41209ab8ed56702e13ba" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 42749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37587 } health_report { overall_health: UNKNOWN } } }
I20260809 02:19:43.730880 19550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.728556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34630 (local address 127.11.93.129:35047)
0809 02:19:43.728631 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:43.728633 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:43.728643 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:19:43.728692 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:43.728693 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:43.728710 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:43.728786 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:19:43.728917 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:43.729400 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:43.730125 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:43.730317 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:43.730388 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:43.730542 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:19:43.730637 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:19:43.730731 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:43.730774 (+ 43us) server_negotiation.cc:299] Negotiation successful
0809 02:19:43.730794 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 02:19:43.732204 19397 raft_consensus.cc:1261] T 13f52fc9077849079f8c0f1a5526781e P 887dc57e6fcd4c4fa6ef7f208b093ddf [term 1 FOLLOWER]: Refusing update from remote peer c5f9d1717edc41209ab8ed56702e13ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:43.732149 19250 raft_consensus.cc:1261] T 13f52fc9077849079f8c0f1a5526781e P ddbaeb0e974f4cb98ce1bb675b60e5c9 [term 1 FOLLOWER]: Refusing update from remote peer c5f9d1717edc41209ab8ed56702e13ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:43.732576 19565 consensus_queue.cc:1035] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "887dc57e6fcd4c4fa6ef7f208b093ddf" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:43.732745 19559 consensus_queue.cc:1035] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddbaeb0e974f4cb98ce1bb675b60e5c9" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:43.733570 19534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.733446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.130:55199)
0809 02:19:43.733494 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.733529 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 02:19:43.734166 19449 heartbeater.cc:503] Master 127.11.93.189:41047 was elected leader, sending a full tablet report...
I20260809 02:19:43.734360 19535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.734107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.131:42565)
0809 02:19:43.734288 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.734327 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160}
I20260809 02:19:43.734869 19534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.734767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.130:41045)
0809 02:19:43.734807 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.734835 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260809 02:19:43.734910 19568 mvcc.cc:205] Tried to move back new op lower bound from 7316447165364367360 to 7316447165259694080. Current Snapshot: MvccSnapshot[applied={T|T < 7316447165364367360}]
I20260809 02:19:43.735258 19564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.734753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.129:49135)
0809 02:19:43.735189 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.735222 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419}
I20260809 02:19:43.736508 19564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.736385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.129:51445)
0809 02:19:43.736436 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.736472 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 02:19:43.737004 19535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.736838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:34587 (local address 127.11.93.131:60845)
0809 02:19:43.736929 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.736968 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260809 02:19:43.738969 18775 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49052:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:43.739130 18775 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49052:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:43.740454 18775 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5ab97c7a07b64751b8dead417fea62a8: Sending DeleteTablet for 3 replicas of tablet 13f52fc9077849079f8c0f1a5526781e
I20260809 02:19:43.740805 19375 tablet_service.cc:1514] Processing DeleteTablet for tablet 13f52fc9077849079f8c0f1a5526781e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:43 UTC) from {username='oryx', principal='oryx/127.11.93.189@KRBTEST.COM'} at 127.0.0.1:33842
I20260809 02:19:43.740911 19088 tablet_service.cc:1514] Processing DeleteTablet for tablet 13f52fc9077849079f8c0f1a5526781e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:43 UTC) from {username='oryx', principal='oryx/127.11.93.189@KRBTEST.COM'} at 127.0.0.1:34618
I20260809 02:19:43.740940 19228 tablet_service.cc:1514] Processing DeleteTablet for tablet 13f52fc9077849079f8c0f1a5526781e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:43 UTC) from {username='oryx', principal='oryx/127.11.93.189@KRBTEST.COM'} at 127.0.0.1:33140
I20260809 02:19:43.741128 19579 tablet_replica.cc:330] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba: stopping tablet replica
I20260809 02:19:43.741145 19580 tablet_replica.cc:330] T 13f52fc9077849079f8c0f1a5526781e P ddbaeb0e974f4cb98ce1bb675b60e5c9: stopping tablet replica
I20260809 02:19:43.741190 19579 raft_consensus.cc:2229] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:19:43.741195 19580 raft_consensus.cc:2229] T 13f52fc9077849079f8c0f1a5526781e P ddbaeb0e974f4cb98ce1bb675b60e5c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:43.741242 19580 raft_consensus.cc:2258] T 13f52fc9077849079f8c0f1a5526781e P ddbaeb0e974f4cb98ce1bb675b60e5c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:43.741274 19579 raft_consensus.cc:2258] T 13f52fc9077849079f8c0f1a5526781e P c5f9d1717edc41209ab8ed56702e13ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:43.741659 19578 tablet_replica.cc:330] T 13f52fc9077849079f8c0f1a5526781e P 887dc57e6fcd4c4fa6ef7f208b093ddf: stopping tablet replica
I20260809 02:19:43.741701 19580 ts_tablet_manager.cc:1905] T 13f52fc9077849079f8c0f1a5526781e P ddbaeb0e974f4cb98ce1bb675b60e5c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:43.741734 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 19021
I20260809 02:19:43.743144 19578 raft_consensus.cc:2229] T 13f52fc9077849079f8c0f1a5526781e P 887dc57e6fcd4c4fa6ef7f208b093ddf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:43.743288 19578 raft_consensus.cc:2258] T 13f52fc9077849079f8c0f1a5526781e P 887dc57e6fcd4c4fa6ef7f208b093ddf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:43.745190 19578 ts_tablet_manager.cc:1905] T 13f52fc9077849079f8c0f1a5526781e P 887dc57e6fcd4c4fa6ef7f208b093ddf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:43.746779 19580 ts_tablet_manager.cc:1918] T 13f52fc9077849079f8c0f1a5526781e P ddbaeb0e974f4cb98ce1bb675b60e5c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:19:43.746866 19580 log.cc:1196] T 13f52fc9077849079f8c0f1a5526781e P ddbaeb0e974f4cb98ce1bb675b60e5c9: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/13f52fc9077849079f8c0f1a5526781e
I20260809 02:19:43.747166 19580 ts_tablet_manager.cc:1939] T 13f52fc9077849079f8c0f1a5526781e P ddbaeb0e974f4cb98ce1bb675b60e5c9: Deleting consensus metadata
I20260809 02:19:43.747435 19578 ts_tablet_manager.cc:1918] T 13f52fc9077849079f8c0f1a5526781e P 887dc57e6fcd4c4fa6ef7f208b093ddf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:19:43.747509 19578 log.cc:1196] T 13f52fc9077849079f8c0f1a5526781e P 887dc57e6fcd4c4fa6ef7f208b093ddf: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/13f52fc9077849079f8c0f1a5526781e
I20260809 02:19:43.747576 18760 catalog_manager.cc:4841] TS ddbaeb0e974f4cb98ce1bb675b60e5c9 (127.11.93.130:42749): tablet 13f52fc9077849079f8c0f1a5526781e (table test-table [id=7aad07c3f83041a89f1e7df3b45c7ecb]) successfully deleted
I20260809 02:19:43.747789 19578 ts_tablet_manager.cc:1939] T 13f52fc9077849079f8c0f1a5526781e P 887dc57e6fcd4c4fa6ef7f208b093ddf: Deleting consensus metadata
I20260809 02:19:43.748183 18763 catalog_manager.cc:4841] TS 887dc57e6fcd4c4fa6ef7f208b093ddf (127.11.93.131:37587): tablet 13f52fc9077849079f8c0f1a5526781e (table test-table [id=7aad07c3f83041a89f1e7df3b45c7ecb]) successfully deleted
I20260809 02:19:43.750110 19551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:43.749976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:35047 (local address 127.0.0.1:34644)
0809 02:19:43.750041 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:43.750072 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.129:35047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 02:19:43.750146 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 19164
W20260809 02:19:43.750293 18760 catalog_manager.cc:4584] TS c5f9d1717edc41209ab8ed56702e13ba (127.11.93.129:35047): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 13f52fc9077849079f8c0f1a5526781e: Network error: Client connection negotiation failed: client connection to 127.11.93.129:35047: connect: Connection refused (error 111)
I20260809 02:19:43.759863 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 19308
I20260809 02:19:43.766460 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 18629
I20260809 02:19:43.772302 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 18831
2026-08-09T02:19:43Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6540 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:19:43 dist-test-slave-w206 krb5kdc[19583](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:19:43 dist-test-slave-w206 krb5kdc[19583](info): set up 2 sockets
Aug 09 02:19:43 dist-test-slave-w206 krb5kdc[19583](info): commencing operation
krb5kdc: starting...
W20260809 02:19:44.846903 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.051s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:19:44 dist-test-slave-w206 krb5kdc[19583](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241984, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:19:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:19:44Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.190.keytab.
Entry for principal oryx/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.190.keytab.
I20260809 02:19:44.975216 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:46597
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.190.keytab
--principal=oryx/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:46597
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:45.058116 19596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:45.058378 19596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:45.058419 19596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:45.059602 19596 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:19:45.059667 19596 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 02:19:45.059688 19596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:45.059710 19596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:45.059737 19596 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:19:45.059767 19596 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:19:45.061297 19596 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:46597
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.190.keytab
--principal=oryx/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:46597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19596
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:45.061581 19596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:45.061815 19596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:45.066655 19601 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:45.066651 19605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:45.066708 19602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:45.066797 19596 server_base.cc:1034] running on GCE node
I20260809 02:19:45.067287 19596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:45.067540 19596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:45.068682 19596 hybrid_clock.cc:648] HybridClock initialized: now 1786241985068668 us; error 30 us; skew 500 ppm
Aug 09 02:19:45 dist-test-slave-w206 krb5kdc[19583](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241985, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:45.071280 19596 init.cc:377] Logged in from keytab as oryx/127.11.93.190@KRBTEST.COM (short username oryx)
I20260809 02:19:45.071745 19596 webserver.cc:460] Webserver started at http://127.11.93.190:41561/ using document root <none> and password file <none>
I20260809 02:19:45.071991 19596 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:45.072057 19596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:45.072198 19596 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:45.073256 19596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "ef548273ab664446820cc479c3a2f124"
format_stamp: "Formatted at 2026-08-09 02:19:45 on dist-test-slave-w206"
server_key: "618613b8edfaf45f6f052df45232e5cc"
server_key_iv: "86103cefdcfc05a67b42c48b7c340c54"
server_key_version: "encryptionkey@0"
I20260809 02:19:45.073698 19596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "ef548273ab664446820cc479c3a2f124"
format_stamp: "Formatted at 2026-08-09 02:19:45 on dist-test-slave-w206"
server_key: "618613b8edfaf45f6f052df45232e5cc"
server_key_iv: "86103cefdcfc05a67b42c48b7c340c54"
server_key_version: "encryptionkey@0"
I20260809 02:19:45.075076 19596 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260809 02:19:45.075871 19614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:45.076036 19596 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:19:45.076136 19596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "ef548273ab664446820cc479c3a2f124"
format_stamp: "Formatted at 2026-08-09 02:19:45 on dist-test-slave-w206"
server_key: "618613b8edfaf45f6f052df45232e5cc"
server_key_iv: "86103cefdcfc05a67b42c48b7c340c54"
server_key_version: "encryptionkey@0"
I20260809 02:19:45.076258 19596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:45.088541 19596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:45.090366 19596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:45.090517 19596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:45.095371 19596 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:46597
I20260809 02:19:45.095420 19680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:46597 every 8 connection(s)
I20260809 02:19:45.095752 19596 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:19:45.096383 19681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:45.098634 19681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124: Bootstrap starting.
I20260809 02:19:45.099298 19681 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:45.099586 19681 log.cc:824] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:45.100261 19681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124: No bootstrap required, opened a new log
I20260809 02:19:45.100627 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 19596
I20260809 02:19:45.100728 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:19:45.100945 11638 external_mini_cluster.cc:1428] Setting key 4bac3992c7d0de75452f07de7818cfe6
I20260809 02:19:45.103029 19681 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef548273ab664446820cc479c3a2f124" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46597 } }
I20260809 02:19:45.103210 19681 raft_consensus.cc:374] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:45.103250 19681 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef548273ab664446820cc479c3a2f124, State: Initialized, Role: FOLLOWER
I20260809 02:19:45.103390 19681 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef548273ab664446820cc479c3a2f124" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46597 } }
I20260809 02:19:45.103482 19681 raft_consensus.cc:388] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:19:45.103519 19681 raft_consensus.cc:482] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:19:45.103578 19681 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:45.104302 19681 raft_consensus.cc:504] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef548273ab664446820cc479c3a2f124" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46597 } }
I20260809 02:19:45.104406 19681 leader_election.cc:302] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef548273ab664446820cc479c3a2f124; no voters:
I20260809 02:19:45.104552 19681 leader_election.cc:288] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:19:45.104617 19686 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:45.104770 19681 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:19:45.104821 19686 raft_consensus.cc:686] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124 [term 1 LEADER]: Becoming Leader. State: Replica: ef548273ab664446820cc479c3a2f124, State: Running, Role: LEADER
I20260809 02:19:45.104929 19686 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef548273ab664446820cc479c3a2f124" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46597 } }
I20260809 02:19:45.105259 19686 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef548273ab664446820cc479c3a2f124. Latest consensus state: current_term: 1 leader_uuid: "ef548273ab664446820cc479c3a2f124" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef548273ab664446820cc479c3a2f124" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46597 } } }
I20260809 02:19:45.105324 19686 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124 [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:45.105448 19687 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef548273ab664446820cc479c3a2f124" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef548273ab664446820cc479c3a2f124" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46597 } } }
I20260809 02:19:45.105515 19687 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124 [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:45.106182 19694 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:19:45.106693 19694 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:19:45.108355 19694 catalog_manager.cc:1347] Generated new cluster ID: 83bcec8f267042d3b65f5f759967a350
I20260809 02:19:45.108413 19694 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 02:19:45 dist-test-slave-w206 krb5kdc[19583](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241984, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM
I20260809 02:19:45.112950 19685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.101527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41334 (local address 127.11.93.190:46597)
0809 02:19:45.101678 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:45.101688 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:45.101725 (+ 37us) server_negotiation.cc:407] Connection header received
0809 02:19:45.102546 (+ 821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:45.102553 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:45.102611 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:45.102731 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:45.103593 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.104948 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.106158 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.106913 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.107035 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.109692 (+ 2657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:45.109695 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:45.109696 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:45.109715 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:45.111464 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:45.111847 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:45.111850 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:45.111851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:45.111953 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:45.112164 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:45.112165 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:45.112166 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:45.112398 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:45.112577 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:45.112652 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 02:19:45.112800 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":70,"threads_started":1}
I20260809 02:19:45.115284 19694 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:19:45.115797 19694 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:19:45.123373 19694 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124: Generated new TSK 0
I20260809 02:19:45.123582 19694 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.93.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.93.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.93.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.129.keytab.
Entry for principal oryx/127.11.93.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.129.keytab.
I20260809 02:19:45.156028 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:46597
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.129.keytab
--principal=oryx/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:45.242947 19708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:45.243211 19708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:45.243235 19708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:45.244385 19708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:45.244426 19708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:45.244474 19708 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:19:45.244510 19708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:19:45.246058 19708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.129.keytab
--principal=oryx/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.93.190:46597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19708
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:45.246308 19708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:45.246537 19708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:45.251807 19713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:45.251847 19714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:45.251832 19716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:45.252123 19708 server_base.cc:1034] running on GCE node
I20260809 02:19:45.252360 19708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:45.252573 19708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:45.253755 19708 hybrid_clock.cc:648] HybridClock initialized: now 1786241985253744 us; error 36 us; skew 500 ppm
Aug 09 02:19:45 dist-test-slave-w206 krb5kdc[19583](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241985, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:45.256323 19708 init.cc:377] Logged in from keytab as oryx/127.11.93.129@KRBTEST.COM (short username oryx)
I20260809 02:19:45.256773 19708 webserver.cc:460] Webserver started at http://127.11.93.129:42427/ using document root <none> and password file <none>
I20260809 02:19:45.257016 19708 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:45.257082 19708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:45.257229 19708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:45.258306 19708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "6925c06f0f294640a74692fa04b82858"
format_stamp: "Formatted at 2026-08-09 02:19:45 on dist-test-slave-w206"
server_key: "9bea92be2e6caf5f5ffdde6d59224b1a"
server_key_iv: "6082f0252f63223f44195f287b2e8196"
server_key_version: "encryptionkey@0"
I20260809 02:19:45.258663 19708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "6925c06f0f294640a74692fa04b82858"
format_stamp: "Formatted at 2026-08-09 02:19:45 on dist-test-slave-w206"
server_key: "9bea92be2e6caf5f5ffdde6d59224b1a"
server_key_iv: "6082f0252f63223f44195f287b2e8196"
server_key_version: "encryptionkey@0"
I20260809 02:19:45.260078 19708 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:19:45.260890 19723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:45.261063 19708 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 02:19:45.261163 19708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "6925c06f0f294640a74692fa04b82858"
format_stamp: "Formatted at 2026-08-09 02:19:45 on dist-test-slave-w206"
server_key: "9bea92be2e6caf5f5ffdde6d59224b1a"
server_key_iv: "6082f0252f63223f44195f287b2e8196"
server_key_version: "encryptionkey@0"
I20260809 02:19:45.261258 19708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:45.287593 19708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:45.289637 19708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:45.289814 19708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:45.290350 19708 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:45.290414 19708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:45.290463 19708 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:45.290488 19708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:19:45 dist-test-slave-w206 krb5kdc[19583](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241985, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM
I20260809 02:19:45.298141 19708 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:46089
I20260809 02:19:45.298493 19708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:19:45.298537 19843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:46089 every 8 connection(s)
I20260809 02:19:45.300668 19685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.290871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:50317 (local address 127.11.93.190:46597)
0809 02:19:45.290942 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:45.290945 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:45.291194 (+ 249us) server_negotiation.cc:407] Connection header received
0809 02:19:45.291680 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:45.291682 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:45.291695 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:45.291769 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:45.292634 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.293519 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.295143 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.295394 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.295483 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.297707 (+ 2224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:45.297708 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:45.297709 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:45.297716 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:45.299257 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:45.299681 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:45.299682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:45.299683 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:45.299744 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:45.300008 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:45.300009 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:45.300010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:45.300130 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:45.300198 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:45.300474 (+ 276us) server_negotiation.cc:299] Negotiation successful
0809 02:19:45.300572 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:19:45.300827 19732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.290858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:46597 (local address 127.11.93.129:50317)
0809 02:19:45.291042 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:45.291083 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:45.291580 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:45.291852 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:45.291856 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:45.292160 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:45.292525 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:45.292532 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.293641 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.293642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:45.295039 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:45.295042 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.295505 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.295507 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:45.295650 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.296168 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:45.296186 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:45.297605 (+ 1419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:45.299355 (+ 1750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:45.299363 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:45.299365 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:45.299592 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:45.299818 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:45.299819 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:45.299820 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:45.299934 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:45.300200 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:45.300207 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:45.300343 (+ 136us) client_negotiation.cc:769] Sending connection context
0809 02:19:45.300440 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 02:19:45.300595 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":124,"threads_started":1}
I20260809 02:19:45.301317 19844 heartbeater.cc:347] Connected to a master server at 127.11.93.190:46597
I20260809 02:19:45.301394 19844 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:45.301569 19844 heartbeater.cc:511] Master 127.11.93.190:46597 requested a full tablet report, sending...
I20260809 02:19:45.302135 19632 ts_manager.cc:194] Registered new tserver with Master: 6925c06f0f294640a74692fa04b82858 (127.11.93.129:46089)
I20260809 02:19:45.302541 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 19708
I20260809 02:19:45.302663 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:19:45.302953 11638 external_mini_cluster.cc:1428] Setting key b1c0b8940446857575d7f44773086130
I20260809 02:19:45.303094 19632 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:50317
I20260809 02:19:45.309818 19852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.302460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:46597 (local address 127.11.93.129:51819)
0809 02:19:45.302679 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:45.302689 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:45.302752 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:45.302895 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:45.302895 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:45.303116 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:45.303196 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:45.303198 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.304214 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.304215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:45.305093 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:45.305096 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.305655 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.305656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:45.305725 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.306251 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:45.306256 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:45.306655 (+ 399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:45.308735 (+ 2080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:45.308736 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:45.308736 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:45.308908 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:45.309128 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:45.309129 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:45.309129 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:45.309186 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:45.309522 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:45.309523 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:45.309570 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 02:19:45.309646 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 02:19:45.309742 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":171,"threads_started":1}
I20260809 02:19:45.309944 19685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.302528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:51819 (local address 127.11.93.190:46597)
0809 02:19:45.302569 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:45.302571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:45.302761 (+ 190us) server_negotiation.cc:407] Connection header received
0809 02:19:45.302795 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:45.302797 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:45.302810 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:45.302893 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:45.303290 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.304113 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.305189 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.305537 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.305639 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.306753 (+ 1114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:45.306754 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:45.306755 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:45.306763 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:45.308622 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:45.308981 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:45.308983 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:45.308983 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:45.309050 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:45.309269 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:45.309270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:45.309270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:45.309429 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:45.309515 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:45.309707 (+ 192us) server_negotiation.cc:299] Negotiation successful
0809 02:19:45.309803 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
WARNING: no policy specified for oryx/127.11.93.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.93.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.93.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.130.keytab.
Entry for principal oryx/127.11.93.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.130.keytab.
I20260809 02:19:45.332105 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:46597
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.130.keytab
--principal=oryx/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:45.413718 19855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:45.413962 19855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:45.414000 19855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:45.415166 19855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:45.415234 19855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:45.415267 19855 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:19:45.415305 19855 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:19:45.416774 19855 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.130.keytab
--principal=oryx/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.93.190:46597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:45.417032 19855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:45.417251 19855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:45.422086 19863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:45.422128 19861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:45.422097 19860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:45.422411 19855 server_base.cc:1034] running on GCE node
I20260809 02:19:45.422658 19855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:45.422912 19855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:45.424093 19855 hybrid_clock.cc:648] HybridClock initialized: now 1786241985424096 us; error 48 us; skew 500 ppm
Aug 09 02:19:45 dist-test-slave-w206 krb5kdc[19583](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241985, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:45.426864 19855 init.cc:377] Logged in from keytab as oryx/127.11.93.130@KRBTEST.COM (short username oryx)
I20260809 02:19:45.427410 19855 webserver.cc:460] Webserver started at http://127.11.93.130:42835/ using document root <none> and password file <none>
I20260809 02:19:45.427662 19855 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:45.427737 19855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:45.427892 19855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:45.429032 19855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "d56d1b1e3ff743a18e0933b85c3f6675"
format_stamp: "Formatted at 2026-08-09 02:19:45 on dist-test-slave-w206"
server_key: "541f9580c3b429678c288ac00ca5b96f"
server_key_iv: "b19e55a380643cc3d5e2f09ec4b91740"
server_key_version: "encryptionkey@0"
I20260809 02:19:45.429427 19855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "d56d1b1e3ff743a18e0933b85c3f6675"
format_stamp: "Formatted at 2026-08-09 02:19:45 on dist-test-slave-w206"
server_key: "541f9580c3b429678c288ac00ca5b96f"
server_key_iv: "b19e55a380643cc3d5e2f09ec4b91740"
server_key_version: "encryptionkey@0"
I20260809 02:19:45.430899 19855 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:19:45.431797 19870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:45.431975 19855 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:45.432085 19855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "d56d1b1e3ff743a18e0933b85c3f6675"
format_stamp: "Formatted at 2026-08-09 02:19:45 on dist-test-slave-w206"
server_key: "541f9580c3b429678c288ac00ca5b96f"
server_key_iv: "b19e55a380643cc3d5e2f09ec4b91740"
server_key_version: "encryptionkey@0"
I20260809 02:19:45.432163 19855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:45.453883 19855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:45.456032 19855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:45.456216 19855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:45.456964 19855 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:45.457077 19855 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:45.457162 19855 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:45.457242 19855 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:19:45 dist-test-slave-w206 krb5kdc[19583](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241985, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM
I20260809 02:19:45.465255 19855 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:45551
I20260809 02:19:45.465514 19989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:45551 every 8 connection(s)
I20260809 02:19:45.465742 19855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:19:45.467574 19685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.457719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:58905 (local address 127.11.93.190:46597)
0809 02:19:45.457782 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:45.457785 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:45.457851 (+ 66us) server_negotiation.cc:407] Connection header received
0809 02:19:45.458362 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:45.458364 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:45.458379 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:45.458479 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:45.459253 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.460206 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.461237 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.461450 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.461534 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.464282 (+ 2748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:45.464284 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:45.464285 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:45.464295 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:45.466221 (+ 1926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:45.466681 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:45.466682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:45.466682 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:45.466748 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:45.466935 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:45.466936 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:45.466936 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:45.467101 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:45.467157 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:45.467434 (+ 277us) server_negotiation.cc:299] Negotiation successful
0809 02:19:45.467503 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 02:19:45.467707 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 19855
I20260809 02:19:45.467803 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:19:45.467902 19879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.457506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:46597 (local address 127.11.93.130:58905)
0809 02:19:45.457712 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:45.457752 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:45.458254 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:45.458527 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:45.458531 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:45.458836 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:45.459142 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:45.459148 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.460326 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.460326 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:45.461142 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:45.461145 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.461546 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.461547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:45.461676 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.462172 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:45.462182 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:45.464167 (+ 1985us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:45.466323 (+ 2156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:45.466330 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:45.466331 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:45.466596 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:45.466796 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:45.466796 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:45.466796 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:45.466894 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:45.467162 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:45.467167 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:45.467298 (+ 131us) client_negotiation.cc:769] Sending connection context
0809 02:19:45.467404 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 02:19:45.467607 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":93,"threads_started":1}
I20260809 02:19:45.468052 11638 external_mini_cluster.cc:1428] Setting key 7e35bfaae99e034da602a0ea268f9345
I20260809 02:19:45.468495 19990 heartbeater.cc:347] Connected to a master server at 127.11.93.190:46597
I20260809 02:19:45.468580 19990 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:45.468793 19990 heartbeater.cc:511] Master 127.11.93.190:46597 requested a full tablet report, sending...
I20260809 02:19:45.469199 19631 ts_manager.cc:194] Registered new tserver with Master: d56d1b1e3ff743a18e0933b85c3f6675 (127.11.93.130:45551)
I20260809 02:19:45.469607 19631 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:58905
WARNING: no policy specified for oryx/127.11.93.131@KRBTEST.COM; defaulting to no policy
I20260809 02:19:45.478157 19997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.471115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:46597 (local address 127.11.93.130:59529)
0809 02:19:45.471324 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:45.471338 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:45.471414 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:45.471536 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:45.471537 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:45.471793 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:45.471872 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:45.471874 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.472757 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.472758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:45.473777 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:45.473780 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.474432 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.474433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:45.474509 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.475060 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:45.475065 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:45.475392 (+ 327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:45.476998 (+ 1606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:45.476999 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:45.476999 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:45.477185 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:45.477411 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:45.477412 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:45.477412 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:45.477483 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:45.477799 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:45.477800 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:45.477850 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 02:19:45.477940 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 02:19:45.478051 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":107,"threads_started":1}
I20260809 02:19:45.478152 19685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.471201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:59529 (local address 127.11.93.190:46597)
0809 02:19:45.471248 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:45.471251 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:45.471453 (+ 202us) server_negotiation.cc:407] Connection header received
0809 02:19:45.471475 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:45.471476 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:45.471486 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:45.471530 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:45.471950 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.472647 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.473896 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.474289 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.474341 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.475496 (+ 1155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:45.475498 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:45.475498 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:45.475505 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:45.476893 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:45.477275 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:45.477277 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:45.477277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:45.477336 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:45.477560 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:45.477561 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:45.477561 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:45.477718 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:45.477795 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:45.477972 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 02:19:45.478052 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.93.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.93.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.131.keytab.
Entry for principal oryx/127.11.93.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.131.keytab.
I20260809 02:19:45.495864 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:46597
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.131.keytab
--principal=oryx/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:45.578395 19999 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:45.578608 19999 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:45.578637 19999 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:45.579880 19999 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:45.579936 19999 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:45.579958 19999 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:19:45.579977 19999 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:19:45.581460 19999 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.131.keytab
--principal=oryx/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.93.190:46597
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19999
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:45.581691 19999 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:45.581912 19999 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:45.587057 20005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:45.587057 20006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:45.587177 19999 server_base.cc:1034] running on GCE node
W20260809 02:19:45.587095 20008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:45.587503 19999 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:45.587710 19999 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:45.588956 19999 hybrid_clock.cc:648] HybridClock initialized: now 1786241985588941 us; error 41 us; skew 500 ppm
Aug 09 02:19:45 dist-test-slave-w206 krb5kdc[19583](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241985, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:45.591470 19999 init.cc:377] Logged in from keytab as oryx/127.11.93.131@KRBTEST.COM (short username oryx)
I20260809 02:19:45.592010 19999 webserver.cc:460] Webserver started at http://127.11.93.131:40617/ using document root <none> and password file <none>
I20260809 02:19:45.592265 19999 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:45.592314 19999 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:45.592476 19999 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:45.593515 19999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "84d6adfff79b472cbc999ba7b69a5e22"
format_stamp: "Formatted at 2026-08-09 02:19:45 on dist-test-slave-w206"
server_key: "68b18d62339690657d674bb087f4d111"
server_key_iv: "18161db6a6d464238782aeade5096773"
server_key_version: "encryptionkey@0"
I20260809 02:19:45.593859 19999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "84d6adfff79b472cbc999ba7b69a5e22"
format_stamp: "Formatted at 2026-08-09 02:19:45 on dist-test-slave-w206"
server_key: "68b18d62339690657d674bb087f4d111"
server_key_iv: "18161db6a6d464238782aeade5096773"
server_key_version: "encryptionkey@0"
I20260809 02:19:45.595271 19999 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 02:19:45.596000 20016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:45.596169 19999 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:19:45.596268 19999 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "84d6adfff79b472cbc999ba7b69a5e22"
format_stamp: "Formatted at 2026-08-09 02:19:45 on dist-test-slave-w206"
server_key: "68b18d62339690657d674bb087f4d111"
server_key_iv: "18161db6a6d464238782aeade5096773"
server_key_version: "encryptionkey@0"
I20260809 02:19:45.596325 19999 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:45.611913 19999 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:45.614097 19999 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:45.614262 19999 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:45.614890 19999 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:45.614941 19999 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:45.615051 19999 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:45.615083 19999 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:19:45 dist-test-slave-w206 krb5kdc[19583](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241985, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM
I20260809 02:19:45.622555 19999 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:36269
I20260809 02:19:45.622648 20139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:36269 every 8 connection(s)
I20260809 02:19:45.623078 19999 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:19:45.625290 19685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.615290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:59533 (local address 127.11.93.190:46597)
0809 02:19:45.615345 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:45.615348 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:45.615605 (+ 257us) server_negotiation.cc:407] Connection header received
0809 02:19:45.616114 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:45.616116 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:45.616131 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:45.616231 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:45.616892 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.617407 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.618478 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.618764 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.618864 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.622143 (+ 3279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:45.622144 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:45.622145 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:45.622153 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:45.623933 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:45.624335 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:45.624336 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:45.624337 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:45.624397 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:45.624652 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:45.624653 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:45.624653 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:45.624780 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:45.624851 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:45.625114 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 02:19:45.625197 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 02:19:45.625516 20025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.615311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:46597 (local address 127.11.93.131:59533)
0809 02:19:45.615474 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:45.615514 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:45.616019 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:45.616282 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:45.616285 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:45.616571 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:45.616797 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:45.616802 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.617516 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.617518 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:45.618386 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:45.618389 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.618873 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.618874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:45.619092 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.619601 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:45.619614 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:45.622042 (+ 2428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:45.624024 (+ 1982us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:45.624030 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:45.624032 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:45.624258 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:45.624467 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:45.624468 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:45.624468 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:45.624579 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:45.624843 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:45.624849 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:45.624987 (+ 138us) client_negotiation.cc:769] Sending connection context
0809 02:19:45.625093 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 02:19:45.625265 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":92,"threads_started":1}
I20260809 02:19:45.625989 20140 heartbeater.cc:347] Connected to a master server at 127.11.93.190:46597
I20260809 02:19:45.626073 20140 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:45.626266 20140 heartbeater.cc:511] Master 127.11.93.190:46597 requested a full tablet report, sending...
I20260809 02:19:45.626685 19632 ts_manager.cc:194] Registered new tserver with Master: 84d6adfff79b472cbc999ba7b69a5e22 (127.11.93.131:36269)
I20260809 02:19:45.627192 19632 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:59533
I20260809 02:19:45.631644 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 19999
I20260809 02:19:45.631763 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:19:45.631989 11638 external_mini_cluster.cc:1428] Setting key 429ba74819bcba4f574d619aaddefb3b
I20260809 02:19:45.632598 19685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.627125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:47635 (local address 127.11.93.190:46597)
0809 02:19:45.627178 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:45.627180 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:45.627263 (+ 83us) server_negotiation.cc:407] Connection header received
0809 02:19:45.627341 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:45.627342 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:45.627353 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:45.627402 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:45.627763 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.628195 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.628861 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.629069 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.629135 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.629948 (+ 813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:45.629950 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:45.629950 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:45.629956 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:45.631429 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:45.631779 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:45.631780 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:45.631780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:45.631844 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:45.632034 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:45.632035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:45.632035 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:45.632171 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:45.632264 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:45.632421 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 02:19:45.632501 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 02:19:45.632617 20147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.627069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:46597 (local address 127.11.93.131:47635)
0809 02:19:45.627191 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:45.627201 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:45.627276 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:45.627405 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:45.627406 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:45.627616 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:45.627685 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:45.627687 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.628277 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.628278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:45.628769 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:45.628771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.629160 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.629161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:45.629221 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.629590 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:45.629594 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:45.629860 (+ 266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:45.631508 (+ 1648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:45.631508 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:45.631509 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:45.631664 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:45.631912 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:45.631913 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:45.631913 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:45.631967 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:45.632241 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:45.632242 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:45.632288 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 02:19:45.632393 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 02:19:45.632506 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":64,"threads_started":1}
I20260809 02:19:45.632906 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 02:19:45 dist-test-slave-w206 krb5kdc[19583](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241985, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 02:19:45 dist-test-slave-w206 krb5kdc[19583](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:45 dist-test-slave-w206 krb5kdc[19583](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
W20260809 02:19:45.655679 19685 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:45.650099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41346 (local address 127.11.93.190:46597)
0809 02:19:45.650202 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:45.650204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:45.650215 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:19:45.650242 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:45.650243 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:45.650252 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:45.650311 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:45.650883 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.651508 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.652303 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.652507 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.652566 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.655579 (+ 3013us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41346: BlockingRecv error: recv got EOF from 127.0.0.1:41346 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 09 02:19:45 dist-test-slave-w206 krb5kdc[19583](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241985, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM
I20260809 02:19:45.662942 19685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.656508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41356 (local address 127.11.93.190:46597)
0809 02:19:45.656550 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:45.656552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:45.656648 (+ 96us) server_negotiation.cc:407] Connection header received
0809 02:19:45.656688 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:45.656689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:45.656696 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:45.656744 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:45.657170 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.657653 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.658285 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.658466 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.658514 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.660630 (+ 2116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:45.660631 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:45.660632 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:45.660638 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:45.661865 (+ 1227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:45.662177 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:45.662178 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:45.662178 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:45.662259 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:45.662473 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:45.662474 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:45.662474 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:45.662592 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:45.662678 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:45.662770 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 02:19:45.662832 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 02:19:45.664911 19632 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41356:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:19:45.666531 19632 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:19:45.673050 20165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.668946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:46089 (local address 127.0.0.1:52546)
0809 02:19:45.669380 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:45.669389 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:45.669435 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:45.669694 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:45.669695 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:45.669697 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:45.669755 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:45.669757 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.670617 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.670618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:45.671788 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:45.671791 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.672742 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.672743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:45.672823 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.672840 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 02:19:45.672917 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 02:19:45.672972 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":422,"mutex_wait_us":2,"thread_start_us":46,"threads_started":1}
I20260809 02:19:45.673094 20168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.669123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52546 (local address 127.11.93.129:46089)
0809 02:19:45.669321 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:45.669326 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:45.669440 (+ 114us) server_negotiation.cc:407] Connection header received
0809 02:19:45.669513 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:45.669516 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:45.669534 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:45.669611 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:45.669857 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.670539 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.671883 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.672654 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.672737 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.672814 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:45.672943 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 02:19:45.672983 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":84,"threads_started":1}
I20260809 02:19:45.673249 20169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.669121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55608 (local address 127.11.93.131:36269)
0809 02:19:45.669349 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:45.669353 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:45.669364 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:19:45.669405 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:45.669407 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:45.669424 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:45.669508 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:45.669770 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.670924 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.672136 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.672677 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.672760 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.672850 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:45.673093 (+ 243us) server_negotiation.cc:299] Negotiation successful
0809 02:19:45.673137 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":83,"threads_started":1}
I20260809 02:19:45.673367 20166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.668946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:36269 (local address 127.0.0.1:55608)
0809 02:19:45.669158 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:45.669201 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:45.669268 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:45.669538 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:45.669541 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:45.669543 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:45.669648 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:45.669651 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.671083 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.671084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:45.672052 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:45.672054 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.672885 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.672886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:45.672952 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.672955 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:19:45.673000 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 02:19:45.673030 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":2,"thread_start_us":93,"threads_started":1}
I20260809 02:19:45.673621 20170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.669219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44530 (local address 127.11.93.130:45551)
0809 02:19:45.669413 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:45.669417 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:45.669628 (+ 211us) server_negotiation.cc:407] Connection header received
0809 02:19:45.669669 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:45.669672 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:45.669693 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:45.669763 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:45.669929 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.671021 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.672183 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.673048 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.673116 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.673187 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:45.673460 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 02:19:45.673509 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":92,"threads_started":1}
I20260809 02:19:45.673565 20167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.668959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:45551 (local address 127.0.0.1:44530)
0809 02:19:45.669518 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:45.669527 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:45.669571 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:45.669829 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:45.669830 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:45.669832 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:45.669864 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:45.669865 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.671101 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.671102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:45.672111 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:45.672114 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.673240 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.673241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:45.673302 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.673372 (+ 70us) client_negotiation.cc:769] Sending connection context
0809 02:19:45.673425 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 02:19:45.673479 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"mutex_wait_us":28,"thread_start_us":109,"threads_started":1}
I20260809 02:19:45.674196 19771 tablet_service.cc:1467] Processing CreateTablet for tablet 1b7b175e3fdf4b86ac8ef7d636821b86 (DEFAULT_TABLE table=test-table [id=0759510fcabc488188d0533d34f18bd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:45.674628 19771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b7b175e3fdf4b86ac8ef7d636821b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:45.674590 19920 tablet_service.cc:1467] Processing CreateTablet for tablet 1b7b175e3fdf4b86ac8ef7d636821b86 (DEFAULT_TABLE table=test-table [id=0759510fcabc488188d0533d34f18bd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:45.674937 19920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b7b175e3fdf4b86ac8ef7d636821b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:45.675436 20070 tablet_service.cc:1467] Processing CreateTablet for tablet 1b7b175e3fdf4b86ac8ef7d636821b86 (DEFAULT_TABLE table=test-table [id=0759510fcabc488188d0533d34f18bd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:45.675729 20070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b7b175e3fdf4b86ac8ef7d636821b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:45.678433 20171 tablet_bootstrap.cc:492] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22: Bootstrap starting.
I20260809 02:19:45.678830 20173 tablet_bootstrap.cc:492] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 6925c06f0f294640a74692fa04b82858: Bootstrap starting.
I20260809 02:19:45.679015 20172 tablet_bootstrap.cc:492] T 1b7b175e3fdf4b86ac8ef7d636821b86 P d56d1b1e3ff743a18e0933b85c3f6675: Bootstrap starting.
I20260809 02:19:45.679155 20171 tablet_bootstrap.cc:654] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:45.679489 20171 log.cc:824] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:45.679522 20173 tablet_bootstrap.cc:654] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 6925c06f0f294640a74692fa04b82858: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:45.679869 20173 log.cc:824] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 6925c06f0f294640a74692fa04b82858: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:45.680174 20172 tablet_bootstrap.cc:654] T 1b7b175e3fdf4b86ac8ef7d636821b86 P d56d1b1e3ff743a18e0933b85c3f6675: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:45.680567 20172 log.cc:824] T 1b7b175e3fdf4b86ac8ef7d636821b86 P d56d1b1e3ff743a18e0933b85c3f6675: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:45.680687 20173 tablet_bootstrap.cc:492] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 6925c06f0f294640a74692fa04b82858: No bootstrap required, opened a new log
I20260809 02:19:45.680774 20173 ts_tablet_manager.cc:1397] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 6925c06f0f294640a74692fa04b82858: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:19:45.681252 20172 tablet_bootstrap.cc:492] T 1b7b175e3fdf4b86ac8ef7d636821b86 P d56d1b1e3ff743a18e0933b85c3f6675: No bootstrap required, opened a new log
I20260809 02:19:45.681334 20172 ts_tablet_manager.cc:1397] T 1b7b175e3fdf4b86ac8ef7d636821b86 P d56d1b1e3ff743a18e0933b85c3f6675: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:19:45.682238 20173 raft_consensus.cc:348] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } }
I20260809 02:19:45.682365 20173 raft_consensus.cc:374] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:45.682389 20173 raft_consensus.cc:729] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6925c06f0f294640a74692fa04b82858, State: Initialized, Role: FOLLOWER
I20260809 02:19:45.682508 20173 consensus_queue.cc:260] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 6925c06f0f294640a74692fa04b82858 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } }
I20260809 02:19:45.682817 20173 ts_tablet_manager.cc:1428] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 6925c06f0f294640a74692fa04b82858: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:19:45.682837 19844 heartbeater.cc:503] Master 127.11.93.190:46597 was elected leader, sending a full tablet report...
I20260809 02:19:45.682798 20172 raft_consensus.cc:348] T 1b7b175e3fdf4b86ac8ef7d636821b86 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } }
I20260809 02:19:45.682967 20172 raft_consensus.cc:374] T 1b7b175e3fdf4b86ac8ef7d636821b86 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:45.683034 20172 raft_consensus.cc:729] T 1b7b175e3fdf4b86ac8ef7d636821b86 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56d1b1e3ff743a18e0933b85c3f6675, State: Initialized, Role: FOLLOWER
I20260809 02:19:45.683132 20172 consensus_queue.cc:260] T 1b7b175e3fdf4b86ac8ef7d636821b86 P d56d1b1e3ff743a18e0933b85c3f6675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } }
I20260809 02:19:45.683329 20171 tablet_bootstrap.cc:492] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22: No bootstrap required, opened a new log
I20260809 02:19:45.683389 20172 ts_tablet_manager.cc:1428] T 1b7b175e3fdf4b86ac8ef7d636821b86 P d56d1b1e3ff743a18e0933b85c3f6675: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:19:45.683396 20171 ts_tablet_manager.cc:1397] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260809 02:19:45.683432 19990 heartbeater.cc:503] Master 127.11.93.190:46597 was elected leader, sending a full tablet report...
I20260809 02:19:45.685284 20171 raft_consensus.cc:348] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } }
I20260809 02:19:45.685401 20171 raft_consensus.cc:374] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:45.685422 20171 raft_consensus.cc:729] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84d6adfff79b472cbc999ba7b69a5e22, State: Initialized, Role: FOLLOWER
I20260809 02:19:45.685493 20171 consensus_queue.cc:260] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } }
I20260809 02:19:45.685674 20171 ts_tablet_manager.cc:1428] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260809 02:19:45.685731 20140 heartbeater.cc:503] Master 127.11.93.190:46597 was elected leader, sending a full tablet report...
W20260809 02:19:45.716357 19991 tablet.cc:2369] T 1b7b175e3fdf4b86ac8ef7d636821b86 P d56d1b1e3ff743a18e0933b85c3f6675: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:19:45.799254 19846 tablet.cc:2369] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 6925c06f0f294640a74692fa04b82858: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:19:45.873762 20141 tablet.cc:2369] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:19:45.971509 20180 raft_consensus.cc:482] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:19:45.971643 20180 raft_consensus.cc:504] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } }
I20260809 02:19:45.971959 20180 leader_election.cc:288] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6925c06f0f294640a74692fa04b82858 (127.11.93.129:46089), d56d1b1e3ff743a18e0933b85c3f6675 (127.11.93.130:45551)
I20260809 02:19:45.974932 20170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.972228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:45765 (local address 127.11.93.130:45551)
0809 02:19:45.972276 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:45.972278 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:45.972524 (+ 246us) server_negotiation.cc:407] Connection header received
0809 02:19:45.972595 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:45.972596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:45.972604 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:45.972671 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:45.972848 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.973361 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.974243 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.974590 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.974670 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.974678 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:45.974831 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 02:19:45.974867 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 02:19:45.974953 20181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.972181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:45551 (local address 127.11.93.131:45765)
0809 02:19:45.972466 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:45.972477 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:45.972533 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:45.972679 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:45.972680 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:45.972682 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:45.972764 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:45.972766 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.973441 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.973442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:45.974160 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:45.974161 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.974670 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.974671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:45.974761 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.974764 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:19:45.974826 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 02:19:45.974863 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"mutex_wait_us":75,"thread_start_us":131,"threads_started":1}
I20260809 02:19:45.975343 20025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.972181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:46089 (local address 127.11.93.131:39647)
0809 02:19:45.972243 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:45.972258 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:45.972329 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:45.972494 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:45.972495 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:45.972497 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:45.972575 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:45.972577 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.973242 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.973244 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:45.974062 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:45.974064 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.974604 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.974605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:45.975160 (+ 555us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.975164 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:19:45.975230 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 02:19:45.975271 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 02:19:45.975374 20168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:45.972271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:39647 (local address 127.11.93.129:46089)
0809 02:19:45.972334 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:45.972336 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:45.972372 (+ 36us) server_negotiation.cc:407] Connection header received
0809 02:19:45.972404 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:45.972405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:45.972416 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:45.972471 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:45.972642 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.973150 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.974155 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:45.974520 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:45.974604 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:45.974614 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:45.975261 (+ 647us) server_negotiation.cc:299] Negotiation successful
0809 02:19:45.975304 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 02:19:45.975394 19938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b7b175e3fdf4b86ac8ef7d636821b86" candidate_uuid: "84d6adfff79b472cbc999ba7b69a5e22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" is_pre_election: true
I20260809 02:19:45.975541 19938 raft_consensus.cc:2454] T 1b7b175e3fdf4b86ac8ef7d636821b86 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84d6adfff79b472cbc999ba7b69a5e22 in term 0.
I20260809 02:19:45.975659 19797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b7b175e3fdf4b86ac8ef7d636821b86" candidate_uuid: "84d6adfff79b472cbc999ba7b69a5e22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6925c06f0f294640a74692fa04b82858" is_pre_election: true
I20260809 02:19:45.975803 20019 leader_election.cc:302] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84d6adfff79b472cbc999ba7b69a5e22, d56d1b1e3ff743a18e0933b85c3f6675; no voters:
I20260809 02:19:45.975831 19797 raft_consensus.cc:2454] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84d6adfff79b472cbc999ba7b69a5e22 in term 0.
I20260809 02:19:45.975934 20180 raft_consensus.cc:2781] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:19:45.976011 20180 raft_consensus.cc:482] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:19:45.976047 20180 raft_consensus.cc:3037] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:45.976760 20180 raft_consensus.cc:504] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } }
I20260809 02:19:45.976905 20180 leader_election.cc:288] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22 [CANDIDATE]: Term 1 election: Requested vote from peers 6925c06f0f294640a74692fa04b82858 (127.11.93.129:46089), d56d1b1e3ff743a18e0933b85c3f6675 (127.11.93.130:45551)
I20260809 02:19:45.977056 19938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b7b175e3fdf4b86ac8ef7d636821b86" candidate_uuid: "84d6adfff79b472cbc999ba7b69a5e22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56d1b1e3ff743a18e0933b85c3f6675"
I20260809 02:19:45.977103 19797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b7b175e3fdf4b86ac8ef7d636821b86" candidate_uuid: "84d6adfff79b472cbc999ba7b69a5e22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6925c06f0f294640a74692fa04b82858"
I20260809 02:19:45.977151 19938 raft_consensus.cc:3037] T 1b7b175e3fdf4b86ac8ef7d636821b86 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:45.977169 19797 raft_consensus.cc:3037] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:45.978030 19938 raft_consensus.cc:2454] T 1b7b175e3fdf4b86ac8ef7d636821b86 P d56d1b1e3ff743a18e0933b85c3f6675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84d6adfff79b472cbc999ba7b69a5e22 in term 1.
I20260809 02:19:45.978030 19797 raft_consensus.cc:2454] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 6925c06f0f294640a74692fa04b82858 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84d6adfff79b472cbc999ba7b69a5e22 in term 1.
I20260809 02:19:45.978214 20019 leader_election.cc:302] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84d6adfff79b472cbc999ba7b69a5e22, d56d1b1e3ff743a18e0933b85c3f6675; no voters:
I20260809 02:19:45.978329 20180 raft_consensus.cc:2781] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:45.978487 20180 raft_consensus.cc:686] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22 [term 1 LEADER]: Becoming Leader. State: Replica: 84d6adfff79b472cbc999ba7b69a5e22, State: Running, Role: LEADER
I20260809 02:19:45.978583 20180 consensus_queue.cc:237] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } }
I20260809 02:19:45.979427 19632 catalog_manager.cc:5495] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84d6adfff79b472cbc999ba7b69a5e22 (127.11.93.131). New cstate: current_term: 1 leader_uuid: "84d6adfff79b472cbc999ba7b69a5e22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } health_report { overall_health: UNKNOWN } } }
I20260809 02:19:46.025633 20169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:46.023182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55622 (local address 127.11.93.131:36269)
0809 02:19:46.023247 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:46.023249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:46.023260 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:19:46.023358 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:46.023359 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:46.023381 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:46.023448 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:19:46.023596 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.024068 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.024799 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.024991 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.025065 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:46.025240 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:19:46.025344 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:19:46.025482 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:46.025507 (+ 25us) server_negotiation.cc:299] Negotiation successful
0809 02:19:46.025528 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 02:19:46.027510 19938 raft_consensus.cc:1261] T 1b7b175e3fdf4b86ac8ef7d636821b86 P d56d1b1e3ff743a18e0933b85c3f6675 [term 1 FOLLOWER]: Refusing update from remote peer 84d6adfff79b472cbc999ba7b69a5e22: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:46.027510 19797 raft_consensus.cc:1261] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 6925c06f0f294640a74692fa04b82858 [term 1 FOLLOWER]: Refusing update from remote peer 84d6adfff79b472cbc999ba7b69a5e22: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:46.027860 20182 consensus_queue.cc:1035] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:46.027998 20180 consensus_queue.cc:1035] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:46.030779 20186 mvcc.cc:205] Tried to move back new op lower bound from 7316447174765662208 to 7316447174568935424. Current Snapshot: MvccSnapshot[applied={T|T < 7316447174765662208}]
I20260809 02:19:46.030807 20187 mvcc.cc:205] Tried to move back new op lower bound from 7316447174765662208 to 7316447174568935424. Current Snapshot: MvccSnapshot[applied={T|T < 7316447174765662208}]
I20260809 02:19:46.031128 20185 mvcc.cc:205] Tried to move back new op lower bound from 7316447174765662208 to 7316447174568935424. Current Snapshot: MvccSnapshot[applied={T|T < 7316447174765662208 or (T in {7316447174765662208})}]
I20260809 02:19:46.032989 19631 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:46.033078 19631 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:46.033821 19631 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124: Sending DeleteTablet for 3 replicas of tablet 1b7b175e3fdf4b86ac8ef7d636821b86
I20260809 02:19:46.034153 19920 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b7b175e3fdf4b86ac8ef7d636821b86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:46 UTC) from {username='oryx', principal='oryx/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:44530
I20260809 02:19:46.034179 19771 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b7b175e3fdf4b86ac8ef7d636821b86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:46 UTC) from {username='oryx', principal='oryx/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:52546
I20260809 02:19:46.034343 20070 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b7b175e3fdf4b86ac8ef7d636821b86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:46 UTC) from {username='oryx', principal='oryx/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:55608
I20260809 02:19:46.034438 20196 tablet_replica.cc:330] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 6925c06f0f294640a74692fa04b82858: stopping tablet replica
I20260809 02:19:46.034533 20196 raft_consensus.cc:2229] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 6925c06f0f294640a74692fa04b82858 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:46.034624 20196 raft_consensus.cc:2258] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 6925c06f0f294640a74692fa04b82858 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:46.034765 20195 tablet_replica.cc:330] T 1b7b175e3fdf4b86ac8ef7d636821b86 P d56d1b1e3ff743a18e0933b85c3f6675: stopping tablet replica
I20260809 02:19:46.034775 19631 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41356:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 02:19:46.034894 20199 tablet_replica.cc:330] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22: stopping tablet replica
I20260809 02:19:46.034940 20195 raft_consensus.cc:2229] T 1b7b175e3fdf4b86ac8ef7d636821b86 P d56d1b1e3ff743a18e0933b85c3f6675 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:46.034989 20199 raft_consensus.cc:2229] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22 [term 1 LEADER]: Raft consensus shutting down.
W20260809 02:19:46.034926 19631 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:19:46.035051 20195 raft_consensus.cc:2258] T 1b7b175e3fdf4b86ac8ef7d636821b86 P d56d1b1e3ff743a18e0933b85c3f6675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:46.035076 20199 raft_consensus.cc:2258] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:46.035717 20196 ts_tablet_manager.cc:1905] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 6925c06f0f294640a74692fa04b82858: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:46.036507 19920 tablet_service.cc:1467] Processing CreateTablet for tablet 96a0948fe6fa4b3296b77e0ac767bc37 (DEFAULT_TABLE table=test-table [id=ccc1c742dea943959ef90ec75027c95d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:46.036512 19771 tablet_service.cc:1467] Processing CreateTablet for tablet 96a0948fe6fa4b3296b77e0ac767bc37 (DEFAULT_TABLE table=test-table [id=ccc1c742dea943959ef90ec75027c95d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:46.036630 19920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96a0948fe6fa4b3296b77e0ac767bc37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:46.036659 19771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96a0948fe6fa4b3296b77e0ac767bc37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:46.037781 20196 ts_tablet_manager.cc:1918] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 6925c06f0f294640a74692fa04b82858: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:19:46.037854 20196 log.cc:1196] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 6925c06f0f294640a74692fa04b82858: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-0/wal/wals/1b7b175e3fdf4b86ac8ef7d636821b86
I20260809 02:19:46.038116 20173 tablet_bootstrap.cc:492] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858: Bootstrap starting.
I20260809 02:19:46.038209 20172 tablet_bootstrap.cc:492] T 96a0948fe6fa4b3296b77e0ac767bc37 P d56d1b1e3ff743a18e0933b85c3f6675: Bootstrap starting.
I20260809 02:19:46.038340 20199 ts_tablet_manager.cc:1905] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:46.038530 20173 tablet_bootstrap.cc:654] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:46.038641 20172 tablet_bootstrap.cc:654] T 96a0948fe6fa4b3296b77e0ac767bc37 P d56d1b1e3ff743a18e0933b85c3f6675: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:46.038122 20196 ts_tablet_manager.cc:1939] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 6925c06f0f294640a74692fa04b82858: Deleting consensus metadata
I20260809 02:19:46.039372 20070 tablet_service.cc:1467] Processing CreateTablet for tablet 96a0948fe6fa4b3296b77e0ac767bc37 (DEFAULT_TABLE table=test-table [id=ccc1c742dea943959ef90ec75027c95d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:46.039448 19616 catalog_manager.cc:4841] TS 6925c06f0f294640a74692fa04b82858 (127.11.93.129:46089): tablet 1b7b175e3fdf4b86ac8ef7d636821b86 (table test-table [id=0759510fcabc488188d0533d34f18bd7]) successfully deleted
I20260809 02:19:46.039486 20070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96a0948fe6fa4b3296b77e0ac767bc37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:46.039532 20195 ts_tablet_manager.cc:1905] T 1b7b175e3fdf4b86ac8ef7d636821b86 P d56d1b1e3ff743a18e0933b85c3f6675: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:46.040797 20171 tablet_bootstrap.cc:492] T 96a0948fe6fa4b3296b77e0ac767bc37 P 84d6adfff79b472cbc999ba7b69a5e22: Bootstrap starting.
I20260809 02:19:46.041229 20171 tablet_bootstrap.cc:654] T 96a0948fe6fa4b3296b77e0ac767bc37 P 84d6adfff79b472cbc999ba7b69a5e22: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:46.041375 20195 ts_tablet_manager.cc:1918] T 1b7b175e3fdf4b86ac8ef7d636821b86 P d56d1b1e3ff743a18e0933b85c3f6675: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:19:46.041435 20195 log.cc:1196] T 1b7b175e3fdf4b86ac8ef7d636821b86 P d56d1b1e3ff743a18e0933b85c3f6675: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/1b7b175e3fdf4b86ac8ef7d636821b86
I20260809 02:19:46.041700 20195 ts_tablet_manager.cc:1939] T 1b7b175e3fdf4b86ac8ef7d636821b86 P d56d1b1e3ff743a18e0933b85c3f6675: Deleting consensus metadata
I20260809 02:19:46.041947 20171 tablet_bootstrap.cc:492] T 96a0948fe6fa4b3296b77e0ac767bc37 P 84d6adfff79b472cbc999ba7b69a5e22: No bootstrap required, opened a new log
I20260809 02:19:46.041988 20199 ts_tablet_manager.cc:1918] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:19:46.042140 20199 log.cc:1196] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/1b7b175e3fdf4b86ac8ef7d636821b86
I20260809 02:19:46.042147 19617 catalog_manager.cc:4841] TS d56d1b1e3ff743a18e0933b85c3f6675 (127.11.93.130:45551): tablet 1b7b175e3fdf4b86ac8ef7d636821b86 (table test-table [id=0759510fcabc488188d0533d34f18bd7]) successfully deleted
I20260809 02:19:46.041996 20171 ts_tablet_manager.cc:1397] T 96a0948fe6fa4b3296b77e0ac767bc37 P 84d6adfff79b472cbc999ba7b69a5e22: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260809 02:19:46.042328 20172 tablet_bootstrap.cc:492] T 96a0948fe6fa4b3296b77e0ac767bc37 P d56d1b1e3ff743a18e0933b85c3f6675: No bootstrap required, opened a new log
I20260809 02:19:46.042372 20172 ts_tablet_manager.cc:1397] T 96a0948fe6fa4b3296b77e0ac767bc37 P d56d1b1e3ff743a18e0933b85c3f6675: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260809 02:19:46.042399 20171 raft_consensus.cc:348] T 96a0948fe6fa4b3296b77e0ac767bc37 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.042472 20171 raft_consensus.cc:374] T 96a0948fe6fa4b3296b77e0ac767bc37 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:46.042531 20171 raft_consensus.cc:729] T 96a0948fe6fa4b3296b77e0ac767bc37 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84d6adfff79b472cbc999ba7b69a5e22, State: Initialized, Role: FOLLOWER
I20260809 02:19:46.042507 20172 raft_consensus.cc:348] T 96a0948fe6fa4b3296b77e0ac767bc37 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.042577 20172 raft_consensus.cc:374] T 96a0948fe6fa4b3296b77e0ac767bc37 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:46.042598 20172 raft_consensus.cc:729] T 96a0948fe6fa4b3296b77e0ac767bc37 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56d1b1e3ff743a18e0933b85c3f6675, State: Initialized, Role: FOLLOWER
I20260809 02:19:46.042575 20171 consensus_queue.cc:260] T 96a0948fe6fa4b3296b77e0ac767bc37 P 84d6adfff79b472cbc999ba7b69a5e22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.042639 20172 consensus_queue.cc:260] T 96a0948fe6fa4b3296b77e0ac767bc37 P d56d1b1e3ff743a18e0933b85c3f6675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.042677 20171 ts_tablet_manager.cc:1428] T 96a0948fe6fa4b3296b77e0ac767bc37 P 84d6adfff79b472cbc999ba7b69a5e22: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:46.042917 20172 ts_tablet_manager.cc:1428] T 96a0948fe6fa4b3296b77e0ac767bc37 P d56d1b1e3ff743a18e0933b85c3f6675: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:46.042469 20199 ts_tablet_manager.cc:1939] T 1b7b175e3fdf4b86ac8ef7d636821b86 P 84d6adfff79b472cbc999ba7b69a5e22: Deleting consensus metadata
I20260809 02:19:46.043388 19618 catalog_manager.cc:4841] TS 84d6adfff79b472cbc999ba7b69a5e22 (127.11.93.131:36269): tablet 1b7b175e3fdf4b86ac8ef7d636821b86 (table test-table [id=0759510fcabc488188d0533d34f18bd7]) successfully deleted
I20260809 02:19:46.043426 20173 tablet_bootstrap.cc:492] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858: No bootstrap required, opened a new log
I20260809 02:19:46.043473 20173 ts_tablet_manager.cc:1397] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260809 02:19:46.043794 20173 raft_consensus.cc:348] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.043852 20173 raft_consensus.cc:374] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:46.043865 20173 raft_consensus.cc:729] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6925c06f0f294640a74692fa04b82858, State: Initialized, Role: FOLLOWER
I20260809 02:19:46.043923 20173 consensus_queue.cc:260] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.044010 20173 ts_tablet_manager.cc:1428] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 02:19:46.192559 20178 raft_consensus.cc:482] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:19:46.192690 20178 raft_consensus.cc:504] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.193071 20178 leader_election.cc:288] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56d1b1e3ff743a18e0933b85c3f6675 (127.11.93.130:45551), 84d6adfff79b472cbc999ba7b69a5e22 (127.11.93.131:36269)
I20260809 02:19:46.197155 20170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:46.193304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:35773 (local address 127.11.93.130:45551)
0809 02:19:46.193364 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:46.193366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:46.193488 (+ 122us) server_negotiation.cc:407] Connection header received
0809 02:19:46.193571 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:46.193573 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:46.193584 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:46.193659 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:46.193840 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.194590 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.196168 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.196756 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.196845 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:46.196856 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:46.197037 (+ 181us) server_negotiation.cc:299] Negotiation successful
0809 02:19:46.197081 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 02:19:46.197206 20169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:46.193384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:51925 (local address 127.11.93.131:36269)
0809 02:19:46.193451 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:46.193460 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:46.193532 (+ 72us) server_negotiation.cc:407] Connection header received
0809 02:19:46.193572 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:46.193573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:46.193586 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:46.193668 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:19:46.193834 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.194590 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.196196 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.196756 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.196846 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:46.196856 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:46.197037 (+ 181us) server_negotiation.cc:299] Negotiation successful
0809 02:19:46.197083 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 02:19:46.197198 20203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:46.193215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:45551 (local address 127.11.93.129:35773)
0809 02:19:46.193401 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:46.193412 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:46.193487 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:46.193672 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:46.193672 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:46.193675 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:46.193761 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:46.193762 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.194675 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.194676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:46.196056 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:46.196060 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.196875 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.196876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:46.196950 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:46.196956 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 02:19:46.197019 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 02:19:46.197068 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":51,"thread_start_us":87,"threads_started":1}
I20260809 02:19:46.197207 20204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:46.193305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:36269 (local address 127.11.93.129:51925)
0809 02:19:46.193461 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:46.193470 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:46.193522 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:46.193672 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:46.193673 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:46.193687 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:19:46.193759 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:46.193761 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.194705 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.194705 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:46.196056 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:46.196060 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.196868 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.196870 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:46.196950 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:46.196959 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 02:19:46.197019 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 02:19:46.197068 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":64,"thread_start_us":103,"threads_started":1}
I20260809 02:19:46.197585 19938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96a0948fe6fa4b3296b77e0ac767bc37" candidate_uuid: "6925c06f0f294640a74692fa04b82858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" is_pre_election: true
I20260809 02:19:46.197678 19938 raft_consensus.cc:2454] T 96a0948fe6fa4b3296b77e0ac767bc37 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6925c06f0f294640a74692fa04b82858 in term 0.
I20260809 02:19:46.197697 20091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96a0948fe6fa4b3296b77e0ac767bc37" candidate_uuid: "6925c06f0f294640a74692fa04b82858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84d6adfff79b472cbc999ba7b69a5e22" is_pre_election: true
I20260809 02:19:46.197867 20091 raft_consensus.cc:2454] T 96a0948fe6fa4b3296b77e0ac767bc37 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6925c06f0f294640a74692fa04b82858 in term 0.
I20260809 02:19:46.197893 19726 leader_election.cc:302] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6925c06f0f294640a74692fa04b82858, d56d1b1e3ff743a18e0933b85c3f6675; no voters:
I20260809 02:19:46.198021 20178 raft_consensus.cc:2781] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:19:46.198067 20178 raft_consensus.cc:482] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:19:46.198087 20178 raft_consensus.cc:3037] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:46.198856 20178 raft_consensus.cc:504] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.199028 20178 leader_election.cc:288] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858 [CANDIDATE]: Term 1 election: Requested vote from peers d56d1b1e3ff743a18e0933b85c3f6675 (127.11.93.130:45551), 84d6adfff79b472cbc999ba7b69a5e22 (127.11.93.131:36269)
I20260809 02:19:46.199201 20091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96a0948fe6fa4b3296b77e0ac767bc37" candidate_uuid: "6925c06f0f294640a74692fa04b82858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84d6adfff79b472cbc999ba7b69a5e22"
I20260809 02:19:46.199215 19938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96a0948fe6fa4b3296b77e0ac767bc37" candidate_uuid: "6925c06f0f294640a74692fa04b82858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56d1b1e3ff743a18e0933b85c3f6675"
I20260809 02:19:46.199291 19938 raft_consensus.cc:3037] T 96a0948fe6fa4b3296b77e0ac767bc37 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:46.199292 20091 raft_consensus.cc:3037] T 96a0948fe6fa4b3296b77e0ac767bc37 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:46.200052 20091 raft_consensus.cc:2454] T 96a0948fe6fa4b3296b77e0ac767bc37 P 84d6adfff79b472cbc999ba7b69a5e22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6925c06f0f294640a74692fa04b82858 in term 1.
I20260809 02:19:46.200304 19727 leader_election.cc:302] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6925c06f0f294640a74692fa04b82858, 84d6adfff79b472cbc999ba7b69a5e22; no voters:
I20260809 02:19:46.200400 20178 raft_consensus.cc:2781] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:46.200395 19938 raft_consensus.cc:2454] T 96a0948fe6fa4b3296b77e0ac767bc37 P d56d1b1e3ff743a18e0933b85c3f6675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6925c06f0f294640a74692fa04b82858 in term 1.
I20260809 02:19:46.200603 20178 raft_consensus.cc:686] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858 [term 1 LEADER]: Becoming Leader. State: Replica: 6925c06f0f294640a74692fa04b82858, State: Running, Role: LEADER
I20260809 02:19:46.200681 20178 consensus_queue.cc:237] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.201483 19632 catalog_manager.cc:5495] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6925c06f0f294640a74692fa04b82858 (127.11.93.129). New cstate: current_term: 1 leader_uuid: "6925c06f0f294640a74692fa04b82858" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } health_report { overall_health: UNKNOWN } } }
Aug 09 02:19:46 dist-test-slave-w206 krb5kdc[19583](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241985, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.190@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM
I20260809 02:19:46.243352 20213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:46.235840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45720 (local address 127.11.93.190:46597)
0809 02:19:46.236198 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:46.236200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:46.236206 (+ 6us) server_negotiation.cc:407] Connection header received
0809 02:19:46.236226 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:46.236227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:46.236238 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:46.236339 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:46.236956 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.237649 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.238395 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.238577 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.238626 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:46.240802 (+ 2176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:46.240803 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:46.240804 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:46.240810 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:46.242153 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:46.242531 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:46.242532 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:46.242532 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:46.242593 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:46.242780 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:46.242781 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:46.242781 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:46.242891 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:46.242966 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:46.243136 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 02:19:46.243224 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":69,"threads_started":1}
I20260809 02:19:46.243412 20212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:46.235796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:46597 (local address 127.0.0.1:45720)
0809 02:19:46.235988 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:46.236002 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:46.236094 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:46.236392 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:46.236393 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:46.236803 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:46.236863 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:46.236867 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.237742 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.237743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:46.238316 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:46.238319 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.238637 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.238638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:46.238680 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:46.239231 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:46.239236 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:46.240721 (+ 1485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:46.242247 (+ 1526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:46.242256 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:46.242258 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:46.242457 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:46.242656 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:46.242656 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:46.242657 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:46.242715 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:46.242958 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:46.242965 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:46.243032 (+ 67us) client_negotiation.cc:769] Sending connection context
0809 02:19:46.243113 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 02:19:46.243293 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":81,"thread_start_us":110,"threads_started":1}
I20260809 02:19:46.245561 19632 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:45720:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 02:19:46.245738 19632 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:19:46.247037 19920 tablet_service.cc:1467] Processing CreateTablet for tablet 520fadeeda6744c991184081b6b29617 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e9d40f8532d64e8cb271094a9a4ef4ed]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:19:46.247058 19771 tablet_service.cc:1467] Processing CreateTablet for tablet 520fadeeda6744c991184081b6b29617 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e9d40f8532d64e8cb271094a9a4ef4ed]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:19:46.247090 20070 tablet_service.cc:1467] Processing CreateTablet for tablet 520fadeeda6744c991184081b6b29617 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e9d40f8532d64e8cb271094a9a4ef4ed]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:19:46.247216 19771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 520fadeeda6744c991184081b6b29617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:46.247216 20070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 520fadeeda6744c991184081b6b29617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:46.247225 19920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 520fadeeda6744c991184081b6b29617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:46.248464 20172 tablet_bootstrap.cc:492] T 520fadeeda6744c991184081b6b29617 P d56d1b1e3ff743a18e0933b85c3f6675: Bootstrap starting.
I20260809 02:19:46.248665 20173 tablet_bootstrap.cc:492] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858: Bootstrap starting.
I20260809 02:19:46.248664 20171 tablet_bootstrap.cc:492] T 520fadeeda6744c991184081b6b29617 P 84d6adfff79b472cbc999ba7b69a5e22: Bootstrap starting.
I20260809 02:19:46.248886 20172 tablet_bootstrap.cc:654] T 520fadeeda6744c991184081b6b29617 P d56d1b1e3ff743a18e0933b85c3f6675: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:46.249023 20171 tablet_bootstrap.cc:654] T 520fadeeda6744c991184081b6b29617 P 84d6adfff79b472cbc999ba7b69a5e22: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:46.249087 20173 tablet_bootstrap.cc:654] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:46.249529 20172 tablet_bootstrap.cc:492] T 520fadeeda6744c991184081b6b29617 P d56d1b1e3ff743a18e0933b85c3f6675: No bootstrap required, opened a new log
I20260809 02:19:46.249583 20172 ts_tablet_manager.cc:1397] T 520fadeeda6744c991184081b6b29617 P d56d1b1e3ff743a18e0933b85c3f6675: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:46.249725 20171 tablet_bootstrap.cc:492] T 520fadeeda6744c991184081b6b29617 P 84d6adfff79b472cbc999ba7b69a5e22: No bootstrap required, opened a new log
I20260809 02:19:46.249718 20172 raft_consensus.cc:348] T 520fadeeda6744c991184081b6b29617 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.249768 20172 raft_consensus.cc:374] T 520fadeeda6744c991184081b6b29617 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:46.249781 20172 raft_consensus.cc:729] T 520fadeeda6744c991184081b6b29617 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56d1b1e3ff743a18e0933b85c3f6675, State: Initialized, Role: FOLLOWER
I20260809 02:19:46.249770 20171 ts_tablet_manager.cc:1397] T 520fadeeda6744c991184081b6b29617 P 84d6adfff79b472cbc999ba7b69a5e22: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260809 02:19:46.249780 20173 tablet_bootstrap.cc:492] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858: No bootstrap required, opened a new log
I20260809 02:19:46.249835 20173 ts_tablet_manager.cc:1397] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:46.249837 20172 consensus_queue.cc:260] T 520fadeeda6744c991184081b6b29617 P d56d1b1e3ff743a18e0933b85c3f6675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.249874 20171 raft_consensus.cc:348] T 520fadeeda6744c991184081b6b29617 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.249929 20172 ts_tablet_manager.cc:1428] T 520fadeeda6744c991184081b6b29617 P d56d1b1e3ff743a18e0933b85c3f6675: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:46.249941 20171 raft_consensus.cc:374] T 520fadeeda6744c991184081b6b29617 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:46.249964 20171 raft_consensus.cc:729] T 520fadeeda6744c991184081b6b29617 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84d6adfff79b472cbc999ba7b69a5e22, State: Initialized, Role: FOLLOWER
I20260809 02:19:46.249974 20173 raft_consensus.cc:348] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.250036 20173 raft_consensus.cc:374] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:46.250008 20171 consensus_queue.cc:260] T 520fadeeda6744c991184081b6b29617 P 84d6adfff79b472cbc999ba7b69a5e22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.249975 20179 tablet_replica.cc:439] T 520fadeeda6744c991184081b6b29617 P d56d1b1e3ff743a18e0933b85c3f6675: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } } }
I20260809 02:19:46.250061 20173 raft_consensus.cc:729] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6925c06f0f294640a74692fa04b82858, State: Initialized, Role: FOLLOWER
I20260809 02:19:46.250065 20179 tablet_replica.cc:442] T 520fadeeda6744c991184081b6b29617 P d56d1b1e3ff743a18e0933b85c3f6675: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:19:46.250106 20171 ts_tablet_manager.cc:1428] T 520fadeeda6744c991184081b6b29617 P 84d6adfff79b472cbc999ba7b69a5e22: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:46.250099 20173 consensus_queue.cc:260] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.250190 20173 ts_tablet_manager.cc:1428] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 02:19:46.250200 20190 tablet_replica.cc:439] T 520fadeeda6744c991184081b6b29617 P 84d6adfff79b472cbc999ba7b69a5e22: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } } }
I20260809 02:19:46.250265 20190 tablet_replica.cc:442] T 520fadeeda6744c991184081b6b29617 P 84d6adfff79b472cbc999ba7b69a5e22: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:19:46.250308 20178 tablet_replica.cc:439] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } } }
I20260809 02:19:46.250368 20178 tablet_replica.cc:442] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:19:46.392251 20178 raft_consensus.cc:482] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:19:46.392375 20178 raft_consensus.cc:504] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.392546 20178 leader_election.cc:288] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d56d1b1e3ff743a18e0933b85c3f6675 (127.11.93.130:45551), 84d6adfff79b472cbc999ba7b69a5e22 (127.11.93.131:36269)
I20260809 02:19:46.392819 19938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "520fadeeda6744c991184081b6b29617" candidate_uuid: "6925c06f0f294640a74692fa04b82858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" is_pre_election: true
I20260809 02:19:46.392817 20091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "520fadeeda6744c991184081b6b29617" candidate_uuid: "6925c06f0f294640a74692fa04b82858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84d6adfff79b472cbc999ba7b69a5e22" is_pre_election: true
I20260809 02:19:46.392910 19938 raft_consensus.cc:2454] T 520fadeeda6744c991184081b6b29617 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6925c06f0f294640a74692fa04b82858 in term 0.
I20260809 02:19:46.392932 20091 raft_consensus.cc:2454] T 520fadeeda6744c991184081b6b29617 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6925c06f0f294640a74692fa04b82858 in term 0.
I20260809 02:19:46.393085 19726 leader_election.cc:302] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6925c06f0f294640a74692fa04b82858, d56d1b1e3ff743a18e0933b85c3f6675; no voters:
I20260809 02:19:46.393209 20178 raft_consensus.cc:2781] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:19:46.393275 20178 raft_consensus.cc:482] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:19:46.393306 20178 raft_consensus.cc:3037] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:46.394162 20178 raft_consensus.cc:504] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.394311 20178 leader_election.cc:288] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858 [CANDIDATE]: Term 1 election: Requested vote from peers d56d1b1e3ff743a18e0933b85c3f6675 (127.11.93.130:45551), 84d6adfff79b472cbc999ba7b69a5e22 (127.11.93.131:36269)
I20260809 02:19:46.394480 20091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "520fadeeda6744c991184081b6b29617" candidate_uuid: "6925c06f0f294640a74692fa04b82858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84d6adfff79b472cbc999ba7b69a5e22"
I20260809 02:19:46.394485 19938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "520fadeeda6744c991184081b6b29617" candidate_uuid: "6925c06f0f294640a74692fa04b82858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56d1b1e3ff743a18e0933b85c3f6675"
I20260809 02:19:46.394559 20091 raft_consensus.cc:3037] T 520fadeeda6744c991184081b6b29617 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:46.394559 19938 raft_consensus.cc:3037] T 520fadeeda6744c991184081b6b29617 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:46.395390 19938 raft_consensus.cc:2454] T 520fadeeda6744c991184081b6b29617 P d56d1b1e3ff743a18e0933b85c3f6675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6925c06f0f294640a74692fa04b82858 in term 1.
I20260809 02:19:46.395390 20091 raft_consensus.cc:2454] T 520fadeeda6744c991184081b6b29617 P 84d6adfff79b472cbc999ba7b69a5e22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6925c06f0f294640a74692fa04b82858 in term 1.
I20260809 02:19:46.395569 19726 leader_election.cc:302] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6925c06f0f294640a74692fa04b82858, d56d1b1e3ff743a18e0933b85c3f6675; no voters:
I20260809 02:19:46.395675 20178 raft_consensus.cc:2781] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:46.395730 20178 raft_consensus.cc:686] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858 [term 1 LEADER]: Becoming Leader. State: Replica: 6925c06f0f294640a74692fa04b82858, State: Running, Role: LEADER
I20260809 02:19:46.395793 20178 consensus_queue.cc:237] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.396144 20205 tablet_replica.cc:439] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858: TxnStatusTablet state changed. Reason: New leader 6925c06f0f294640a74692fa04b82858. Latest consensus state: current_term: 1 leader_uuid: "6925c06f0f294640a74692fa04b82858" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } } }
I20260809 02:19:46.396268 20205 tablet_replica.cc:442] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:19:46.396477 20218 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 02:19:46.396482 19631 catalog_manager.cc:5495] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6925c06f0f294640a74692fa04b82858 (127.11.93.129). New cstate: current_term: 1 leader_uuid: "6925c06f0f294640a74692fa04b82858" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } health_report { overall_health: UNKNOWN } } }
I20260809 02:19:46.396601 20218 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 02:19:46.434880 20212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:46.432294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:46089 (local address 127.0.0.1:52558)
0809 02:19:46.432367 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:46.432379 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:46.432445 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:46.432629 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:46.432630 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:46.432631 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:19:46.432692 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:46.432694 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.433353 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.433354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:46.433933 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:46.433935 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.434289 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.434290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:46.434360 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:46.434374 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:19:46.434697 (+ 323us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:19:46.434717 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 02:19:46.434762 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 02:19:46.434813 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 02:19:46.434864 20168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:46.432389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52558 (local address 127.11.93.129:46089)
0809 02:19:46.432456 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:46.432459 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:46.432470 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:19:46.432530 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:46.432531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:46.432555 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:46.432624 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:19:46.432776 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.433271 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.434018 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.434217 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.434291 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:46.434474 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:19:46.434627 (+ 153us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:19:46.434699 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:46.434766 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 02:19:46.434784 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:19:46.436293 20091 raft_consensus.cc:1261] T 520fadeeda6744c991184081b6b29617 P 84d6adfff79b472cbc999ba7b69a5e22 [term 1 FOLLOWER]: Refusing update from remote peer 6925c06f0f294640a74692fa04b82858: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:46.436532 19938 raft_consensus.cc:1261] T 520fadeeda6744c991184081b6b29617 P d56d1b1e3ff743a18e0933b85c3f6675 [term 1 FOLLOWER]: Refusing update from remote peer 6925c06f0f294640a74692fa04b82858: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:46.436621 20205 consensus_queue.cc:1035] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:46.436762 20178 consensus_queue.cc:1035] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:46.437398 20179 tablet_replica.cc:439] T 520fadeeda6744c991184081b6b29617 P d56d1b1e3ff743a18e0933b85c3f6675: TxnStatusTablet state changed. Reason: New leader 6925c06f0f294640a74692fa04b82858. Latest consensus state: current_term: 1 leader_uuid: "6925c06f0f294640a74692fa04b82858" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } } }
I20260809 02:19:46.437489 20179 tablet_replica.cc:442] T 520fadeeda6744c991184081b6b29617 P d56d1b1e3ff743a18e0933b85c3f6675: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:19:46.437487 20190 tablet_replica.cc:439] T 520fadeeda6744c991184081b6b29617 P 84d6adfff79b472cbc999ba7b69a5e22: TxnStatusTablet state changed. Reason: New leader 6925c06f0f294640a74692fa04b82858. Latest consensus state: current_term: 1 leader_uuid: "6925c06f0f294640a74692fa04b82858" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } } }
I20260809 02:19:46.437588 20190 tablet_replica.cc:442] T 520fadeeda6744c991184081b6b29617 P 84d6adfff79b472cbc999ba7b69a5e22: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:19:46.438401 20178 tablet_replica.cc:439] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6925c06f0f294640a74692fa04b82858" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } } }
I20260809 02:19:46.438488 20178 tablet_replica.cc:442] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:19:46.438499 20205 tablet_replica.cc:439] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6925c06f0f294640a74692fa04b82858" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } } }
I20260809 02:19:46.438577 20205 tablet_replica.cc:442] T 520fadeeda6744c991184081b6b29617 P 6925c06f0f294640a74692fa04b82858: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:19:46.438675 20190 tablet_replica.cc:439] T 520fadeeda6744c991184081b6b29617 P 84d6adfff79b472cbc999ba7b69a5e22: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6925c06f0f294640a74692fa04b82858" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } } }
I20260809 02:19:46.438766 20190 tablet_replica.cc:442] T 520fadeeda6744c991184081b6b29617 P 84d6adfff79b472cbc999ba7b69a5e22: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:19:46.439525 20179 tablet_replica.cc:439] T 520fadeeda6744c991184081b6b29617 P d56d1b1e3ff743a18e0933b85c3f6675: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6925c06f0f294640a74692fa04b82858" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } } }
I20260809 02:19:46.439604 20179 tablet_replica.cc:442] T 520fadeeda6744c991184081b6b29617 P d56d1b1e3ff743a18e0933b85c3f6675: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:19:46.443581 20168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:46.441107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52572 (local address 127.11.93.129:46089)
0809 02:19:46.441156 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:46.441158 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:46.441167 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:19:46.441187 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:46.441188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:46.441198 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:46.441266 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:19:46.441353 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.442094 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.442819 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.443137 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.443209 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:46.443353 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:19:46.443395 (+ 42us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:19:46.443455 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:46.443494 (+ 39us) server_negotiation.cc:299] Negotiation successful
0809 02:19:46.443512 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 02:19:46.448381 20168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:46.445863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:39435 (local address 127.11.93.129:46089)
0809 02:19:46.445902 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:46.445903 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:46.446043 (+ 140us) server_negotiation.cc:407] Connection header received
0809 02:19:46.446083 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:46.446084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:46.446094 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:46.446138 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:19:46.446274 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.446680 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.447784 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.447953 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.448010 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:46.448183 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:19:46.448206 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:19:46.448243 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:46.448294 (+ 51us) server_negotiation.cc:299] Negotiation successful
0809 02:19:46.448311 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 02:19:46.448469 20226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:46.445775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:46089 (local address 127.11.93.129:39435)
0809 02:19:46.445937 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:46.445966 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:46.446028 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:46.446151 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:46.446152 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:46.446153 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:19:46.446215 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:46.446216 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.446759 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.446760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:46.447697 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:46.447700 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.448027 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.448028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:46.448096 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:46.448110 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:19:46.448244 (+ 134us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:19:46.448245 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 02:19:46.448293 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 02:19:46.448332 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":85,"threads_started":1}
I20260809 02:19:46.450543 20091 raft_consensus.cc:1261] T 96a0948fe6fa4b3296b77e0ac767bc37 P 84d6adfff79b472cbc999ba7b69a5e22 [term 1 FOLLOWER]: Refusing update from remote peer 6925c06f0f294640a74692fa04b82858: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:46.450567 19938 raft_consensus.cc:1261] T 96a0948fe6fa4b3296b77e0ac767bc37 P d56d1b1e3ff743a18e0933b85c3f6675 [term 1 FOLLOWER]: Refusing update from remote peer 6925c06f0f294640a74692fa04b82858: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:46.450749 20223 consensus_queue.cc:1035] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:46.450865 20205 consensus_queue.cc:1035] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:46.465288 19630 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:46.465411 19630 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:46.469187 19630 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124: Sending DeleteTablet for 3 replicas of tablet 96a0948fe6fa4b3296b77e0ac767bc37
I20260809 02:19:46.469498 19920 tablet_service.cc:1514] Processing DeleteTablet for tablet 96a0948fe6fa4b3296b77e0ac767bc37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:46 UTC) from {username='oryx', principal='oryx/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:44530
I20260809 02:19:46.469652 20195 tablet_replica.cc:330] T 96a0948fe6fa4b3296b77e0ac767bc37 P d56d1b1e3ff743a18e0933b85c3f6675: stopping tablet replica
I20260809 02:19:46.469645 20070 tablet_service.cc:1514] Processing DeleteTablet for tablet 96a0948fe6fa4b3296b77e0ac767bc37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:46 UTC) from {username='oryx', principal='oryx/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:55608
I20260809 02:19:46.469738 20195 raft_consensus.cc:2229] T 96a0948fe6fa4b3296b77e0ac767bc37 P d56d1b1e3ff743a18e0933b85c3f6675 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:46.469750 20199 tablet_replica.cc:330] T 96a0948fe6fa4b3296b77e0ac767bc37 P 84d6adfff79b472cbc999ba7b69a5e22: stopping tablet replica
I20260809 02:19:46.469787 20195 raft_consensus.cc:2258] T 96a0948fe6fa4b3296b77e0ac767bc37 P d56d1b1e3ff743a18e0933b85c3f6675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:46.469799 20199 raft_consensus.cc:2229] T 96a0948fe6fa4b3296b77e0ac767bc37 P 84d6adfff79b472cbc999ba7b69a5e22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:46.469844 20199 raft_consensus.cc:2258] T 96a0948fe6fa4b3296b77e0ac767bc37 P 84d6adfff79b472cbc999ba7b69a5e22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:46.470183 20199 ts_tablet_manager.cc:1905] T 96a0948fe6fa4b3296b77e0ac767bc37 P 84d6adfff79b472cbc999ba7b69a5e22: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:46.470188 20195 ts_tablet_manager.cc:1905] T 96a0948fe6fa4b3296b77e0ac767bc37 P d56d1b1e3ff743a18e0933b85c3f6675: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:46.471659 20199 ts_tablet_manager.cc:1918] T 96a0948fe6fa4b3296b77e0ac767bc37 P 84d6adfff79b472cbc999ba7b69a5e22: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:19:46.471733 20199 log.cc:1196] T 96a0948fe6fa4b3296b77e0ac767bc37 P 84d6adfff79b472cbc999ba7b69a5e22: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/96a0948fe6fa4b3296b77e0ac767bc37
I20260809 02:19:46.471983 20199 ts_tablet_manager.cc:1939] T 96a0948fe6fa4b3296b77e0ac767bc37 P 84d6adfff79b472cbc999ba7b69a5e22: Deleting consensus metadata
I20260809 02:19:46.472153 20195 ts_tablet_manager.cc:1918] T 96a0948fe6fa4b3296b77e0ac767bc37 P d56d1b1e3ff743a18e0933b85c3f6675: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:19:46.472208 20195 log.cc:1196] T 96a0948fe6fa4b3296b77e0ac767bc37 P d56d1b1e3ff743a18e0933b85c3f6675: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/96a0948fe6fa4b3296b77e0ac767bc37
I20260809 02:19:46.472433 20195 ts_tablet_manager.cc:1939] T 96a0948fe6fa4b3296b77e0ac767bc37 P d56d1b1e3ff743a18e0933b85c3f6675: Deleting consensus metadata
I20260809 02:19:46.472744 19618 catalog_manager.cc:4841] TS 84d6adfff79b472cbc999ba7b69a5e22 (127.11.93.131:36269): tablet 96a0948fe6fa4b3296b77e0ac767bc37 (table test-table [id=ccc1c742dea943959ef90ec75027c95d]) successfully deleted
I20260809 02:19:46.472949 19617 catalog_manager.cc:4841] TS d56d1b1e3ff743a18e0933b85c3f6675 (127.11.93.130:45551): tablet 96a0948fe6fa4b3296b77e0ac767bc37 (table test-table [id=ccc1c742dea943959ef90ec75027c95d]) successfully deleted
I20260809 02:19:46.473596 19771 tablet_service.cc:1514] Processing DeleteTablet for tablet 96a0948fe6fa4b3296b77e0ac767bc37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:46 UTC) from {username='oryx', principal='oryx/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:52546
I20260809 02:19:46.473752 20196 tablet_replica.cc:330] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858: stopping tablet replica
I20260809 02:19:46.473824 20196 raft_consensus.cc:2229] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:19:46.473934 20196 raft_consensus.cc:2258] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:46.474287 20196 ts_tablet_manager.cc:1905] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:46.476089 20196 ts_tablet_manager.cc:1918] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:19:46.476161 20196 log.cc:1196] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-0/wal/wals/96a0948fe6fa4b3296b77e0ac767bc37
I20260809 02:19:46.476379 20196 ts_tablet_manager.cc:1939] T 96a0948fe6fa4b3296b77e0ac767bc37 P 6925c06f0f294640a74692fa04b82858: Deleting consensus metadata
I20260809 02:19:46.476794 19616 catalog_manager.cc:4841] TS 6925c06f0f294640a74692fa04b82858 (127.11.93.129:46089): tablet 96a0948fe6fa4b3296b77e0ac767bc37 (table test-table [id=ccc1c742dea943959ef90ec75027c95d]) successfully deleted
Aug 09 02:19:46 dist-test-slave-w206 krb5kdc[19583](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241986, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 02:19:46 dist-test-slave-w206 krb5kdc[19583](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:46 dist-test-slave-w206 krb5kdc[19583](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
W20260809 02:19:46.499127 20213 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:46.492790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45736 (local address 127.11.93.190:46597)
0809 02:19:46.492866 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:46.492869 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:46.492964 (+ 95us) server_negotiation.cc:407] Connection header received
0809 02:19:46.493079 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:46.493079 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:46.493096 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:46.493248 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:46.493902 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.494437 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.495371 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.495592 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.495676 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:46.499051 (+ 3375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45736: BlockingRecv error: recv got EOF from 127.0.0.1:45736 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 09 02:19:46 dist-test-slave-w206 krb5kdc[19583](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241986, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM
I20260809 02:19:46.508695 20213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:46.499959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45742 (local address 127.11.93.190:46597)
0809 02:19:46.500001 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:46.500003 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:46.500113 (+ 110us) server_negotiation.cc:407] Connection header received
0809 02:19:46.500202 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:46.500203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:46.500213 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:46.500258 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:46.500795 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.501434 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.502152 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.502489 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.502552 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:46.505770 (+ 3218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:46.505772 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:46.505772 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:46.505780 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:46.507470 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:46.507838 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:46.507839 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:46.507840 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:46.507905 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:46.508154 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:46.508155 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:46.508156 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:46.508300 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:46.508404 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:46.508495 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 02:19:46.508583 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 02:19:46.510413 19630 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45742:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:19:46.510605 19630 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:19:46.512053 19771 tablet_service.cc:1467] Processing CreateTablet for tablet 3efcb8281a5241bcb8cd32ab5eaae269 (DEFAULT_TABLE table=test-table [id=1a4b5df1040340f9a0599872a870353e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:46.512133 19920 tablet_service.cc:1467] Processing CreateTablet for tablet 3efcb8281a5241bcb8cd32ab5eaae269 (DEFAULT_TABLE table=test-table [id=1a4b5df1040340f9a0599872a870353e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:46.512133 20070 tablet_service.cc:1467] Processing CreateTablet for tablet 3efcb8281a5241bcb8cd32ab5eaae269 (DEFAULT_TABLE table=test-table [id=1a4b5df1040340f9a0599872a870353e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:46.512270 19771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3efcb8281a5241bcb8cd32ab5eaae269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:46.512292 19920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3efcb8281a5241bcb8cd32ab5eaae269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:46.512300 20070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3efcb8281a5241bcb8cd32ab5eaae269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:46.513660 20173 tablet_bootstrap.cc:492] T 3efcb8281a5241bcb8cd32ab5eaae269 P 6925c06f0f294640a74692fa04b82858: Bootstrap starting.
I20260809 02:19:46.513810 20172 tablet_bootstrap.cc:492] T 3efcb8281a5241bcb8cd32ab5eaae269 P d56d1b1e3ff743a18e0933b85c3f6675: Bootstrap starting.
I20260809 02:19:46.513823 20171 tablet_bootstrap.cc:492] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22: Bootstrap starting.
I20260809 02:19:46.514112 20173 tablet_bootstrap.cc:654] T 3efcb8281a5241bcb8cd32ab5eaae269 P 6925c06f0f294640a74692fa04b82858: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:46.514201 20171 tablet_bootstrap.cc:654] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:46.514223 20172 tablet_bootstrap.cc:654] T 3efcb8281a5241bcb8cd32ab5eaae269 P d56d1b1e3ff743a18e0933b85c3f6675: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:46.515163 20173 tablet_bootstrap.cc:492] T 3efcb8281a5241bcb8cd32ab5eaae269 P 6925c06f0f294640a74692fa04b82858: No bootstrap required, opened a new log
I20260809 02:19:46.515228 20173 ts_tablet_manager.cc:1397] T 3efcb8281a5241bcb8cd32ab5eaae269 P 6925c06f0f294640a74692fa04b82858: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:19:46.515259 20171 tablet_bootstrap.cc:492] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22: No bootstrap required, opened a new log
I20260809 02:19:46.515326 20171 ts_tablet_manager.cc:1397] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260809 02:19:46.515393 20173 raft_consensus.cc:348] T 3efcb8281a5241bcb8cd32ab5eaae269 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.515471 20173 raft_consensus.cc:374] T 3efcb8281a5241bcb8cd32ab5eaae269 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:46.515492 20173 raft_consensus.cc:729] T 3efcb8281a5241bcb8cd32ab5eaae269 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6925c06f0f294640a74692fa04b82858, State: Initialized, Role: FOLLOWER
I20260809 02:19:46.515492 20171 raft_consensus.cc:348] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.515544 20173 consensus_queue.cc:260] T 3efcb8281a5241bcb8cd32ab5eaae269 P 6925c06f0f294640a74692fa04b82858 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.515576 20171 raft_consensus.cc:374] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:46.515607 20171 raft_consensus.cc:729] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84d6adfff79b472cbc999ba7b69a5e22, State: Initialized, Role: FOLLOWER
I20260809 02:19:46.515662 20173 ts_tablet_manager.cc:1428] T 3efcb8281a5241bcb8cd32ab5eaae269 P 6925c06f0f294640a74692fa04b82858: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:46.515666 20171 consensus_queue.cc:260] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.515779 20171 ts_tablet_manager.cc:1428] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:46.516011 20172 tablet_bootstrap.cc:492] T 3efcb8281a5241bcb8cd32ab5eaae269 P d56d1b1e3ff743a18e0933b85c3f6675: No bootstrap required, opened a new log
I20260809 02:19:46.516062 20172 ts_tablet_manager.cc:1397] T 3efcb8281a5241bcb8cd32ab5eaae269 P d56d1b1e3ff743a18e0933b85c3f6675: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:19:46.516203 20172 raft_consensus.cc:348] T 3efcb8281a5241bcb8cd32ab5eaae269 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.516294 20172 raft_consensus.cc:374] T 3efcb8281a5241bcb8cd32ab5eaae269 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:46.516320 20172 raft_consensus.cc:729] T 3efcb8281a5241bcb8cd32ab5eaae269 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56d1b1e3ff743a18e0933b85c3f6675, State: Initialized, Role: FOLLOWER
I20260809 02:19:46.516371 20172 consensus_queue.cc:260] T 3efcb8281a5241bcb8cd32ab5eaae269 P d56d1b1e3ff743a18e0933b85c3f6675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.516481 20172 ts_tablet_manager.cc:1428] T 3efcb8281a5241bcb8cd32ab5eaae269 P d56d1b1e3ff743a18e0933b85c3f6675: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 02:19:46.544917 20190 raft_consensus.cc:482] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:19:46.545033 20190 raft_consensus.cc:504] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.545202 20190 leader_election.cc:288] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6925c06f0f294640a74692fa04b82858 (127.11.93.129:46089), d56d1b1e3ff743a18e0933b85c3f6675 (127.11.93.130:45551)
I20260809 02:19:46.545408 19797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3efcb8281a5241bcb8cd32ab5eaae269" candidate_uuid: "84d6adfff79b472cbc999ba7b69a5e22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6925c06f0f294640a74692fa04b82858" is_pre_election: true
I20260809 02:19:46.545497 19797 raft_consensus.cc:2454] T 3efcb8281a5241bcb8cd32ab5eaae269 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84d6adfff79b472cbc999ba7b69a5e22 in term 0.
I20260809 02:19:46.545454 19941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3efcb8281a5241bcb8cd32ab5eaae269" candidate_uuid: "84d6adfff79b472cbc999ba7b69a5e22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" is_pre_election: true
I20260809 02:19:46.545579 19941 raft_consensus.cc:2454] T 3efcb8281a5241bcb8cd32ab5eaae269 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84d6adfff79b472cbc999ba7b69a5e22 in term 0.
I20260809 02:19:46.545643 20018 leader_election.cc:302] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6925c06f0f294640a74692fa04b82858, 84d6adfff79b472cbc999ba7b69a5e22; no voters:
I20260809 02:19:46.545738 20190 raft_consensus.cc:2781] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:19:46.545774 20190 raft_consensus.cc:482] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:19:46.545812 20190 raft_consensus.cc:3037] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:46.546841 20190 raft_consensus.cc:504] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.547031 20190 leader_election.cc:288] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22 [CANDIDATE]: Term 1 election: Requested vote from peers 6925c06f0f294640a74692fa04b82858 (127.11.93.129:46089), d56d1b1e3ff743a18e0933b85c3f6675 (127.11.93.130:45551)
I20260809 02:19:46.547183 19797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3efcb8281a5241bcb8cd32ab5eaae269" candidate_uuid: "84d6adfff79b472cbc999ba7b69a5e22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6925c06f0f294640a74692fa04b82858"
I20260809 02:19:46.547252 19797 raft_consensus.cc:3037] T 3efcb8281a5241bcb8cd32ab5eaae269 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:46.547233 19941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3efcb8281a5241bcb8cd32ab5eaae269" candidate_uuid: "84d6adfff79b472cbc999ba7b69a5e22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56d1b1e3ff743a18e0933b85c3f6675"
I20260809 02:19:46.547343 19941 raft_consensus.cc:3037] T 3efcb8281a5241bcb8cd32ab5eaae269 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:46.547969 19797 raft_consensus.cc:2454] T 3efcb8281a5241bcb8cd32ab5eaae269 P 6925c06f0f294640a74692fa04b82858 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84d6adfff79b472cbc999ba7b69a5e22 in term 1.
I20260809 02:19:46.548132 20018 leader_election.cc:302] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6925c06f0f294640a74692fa04b82858, 84d6adfff79b472cbc999ba7b69a5e22; no voters:
I20260809 02:19:46.548214 20190 raft_consensus.cc:2781] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:46.548322 20190 raft_consensus.cc:686] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22 [term 1 LEADER]: Becoming Leader. State: Replica: 84d6adfff79b472cbc999ba7b69a5e22, State: Running, Role: LEADER
I20260809 02:19:46.548373 20190 consensus_queue.cc:237] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.548453 19941 raft_consensus.cc:2454] T 3efcb8281a5241bcb8cd32ab5eaae269 P d56d1b1e3ff743a18e0933b85c3f6675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84d6adfff79b472cbc999ba7b69a5e22 in term 1.
I20260809 02:19:46.548977 19631 catalog_manager.cc:5495] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84d6adfff79b472cbc999ba7b69a5e22 (127.11.93.131). New cstate: current_term: 1 leader_uuid: "84d6adfff79b472cbc999ba7b69a5e22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } health_report { overall_health: HEALTHY } } }
I20260809 02:19:46.554373 20169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:46.551770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55634 (local address 127.11.93.131:36269)
0809 02:19:46.551821 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:46.551824 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:46.551840 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:19:46.551867 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:46.551868 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:46.551877 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:46.551926 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:19:46.552069 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.552584 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.553666 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.553898 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.553957 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:46.554133 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:19:46.554160 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:19:46.554198 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:46.554277 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 02:19:46.554297 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 02:19:46.555115 19941 raft_consensus.cc:1261] T 3efcb8281a5241bcb8cd32ab5eaae269 P d56d1b1e3ff743a18e0933b85c3f6675 [term 1 FOLLOWER]: Refusing update from remote peer 84d6adfff79b472cbc999ba7b69a5e22: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:46.555119 19797 raft_consensus.cc:1261] T 3efcb8281a5241bcb8cd32ab5eaae269 P 6925c06f0f294640a74692fa04b82858 [term 1 FOLLOWER]: Refusing update from remote peer 84d6adfff79b472cbc999ba7b69a5e22: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:46.555378 20249 consensus_queue.cc:1035] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:46.555537 20190 consensus_queue.cc:1035] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:46.558213 19630 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45742:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:46.558305 19630 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45742:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:46.558946 19630 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124: Sending DeleteTablet for 3 replicas of tablet 3efcb8281a5241bcb8cd32ab5eaae269
I20260809 02:19:46.559212 19920 tablet_service.cc:1514] Processing DeleteTablet for tablet 3efcb8281a5241bcb8cd32ab5eaae269 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:46 UTC) from {username='oryx', principal='oryx/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:44530
I20260809 02:19:46.559227 20070 tablet_service.cc:1514] Processing DeleteTablet for tablet 3efcb8281a5241bcb8cd32ab5eaae269 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:46 UTC) from {username='oryx', principal='oryx/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:55608
I20260809 02:19:46.559306 20199 tablet_replica.cc:330] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22: stopping tablet replica
I20260809 02:19:46.559306 20195 tablet_replica.cc:330] T 3efcb8281a5241bcb8cd32ab5eaae269 P d56d1b1e3ff743a18e0933b85c3f6675: stopping tablet replica
I20260809 02:19:46.559350 20199 raft_consensus.cc:2229] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:19:46.559362 20195 raft_consensus.cc:2229] T 3efcb8281a5241bcb8cd32ab5eaae269 P d56d1b1e3ff743a18e0933b85c3f6675 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:46.559398 20199 raft_consensus.cc:2258] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:46.559407 20195 raft_consensus.cc:2258] T 3efcb8281a5241bcb8cd32ab5eaae269 P d56d1b1e3ff743a18e0933b85c3f6675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:46.559736 20199 ts_tablet_manager.cc:1905] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:46.559768 20195 ts_tablet_manager.cc:1905] T 3efcb8281a5241bcb8cd32ab5eaae269 P d56d1b1e3ff743a18e0933b85c3f6675: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:46.561049 20195 ts_tablet_manager.cc:1918] T 3efcb8281a5241bcb8cd32ab5eaae269 P d56d1b1e3ff743a18e0933b85c3f6675: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:19:46.561131 20195 log.cc:1196] T 3efcb8281a5241bcb8cd32ab5eaae269 P d56d1b1e3ff743a18e0933b85c3f6675: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/3efcb8281a5241bcb8cd32ab5eaae269
I20260809 02:19:46.561234 20199 ts_tablet_manager.cc:1918] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:19:46.561299 20199 log.cc:1196] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/3efcb8281a5241bcb8cd32ab5eaae269
I20260809 02:19:46.561416 20195 ts_tablet_manager.cc:1939] T 3efcb8281a5241bcb8cd32ab5eaae269 P d56d1b1e3ff743a18e0933b85c3f6675: Deleting consensus metadata
I20260809 02:19:46.561537 20199 ts_tablet_manager.cc:1939] T 3efcb8281a5241bcb8cd32ab5eaae269 P 84d6adfff79b472cbc999ba7b69a5e22: Deleting consensus metadata
I20260809 02:19:46.561745 19617 catalog_manager.cc:4841] TS d56d1b1e3ff743a18e0933b85c3f6675 (127.11.93.130:45551): tablet 3efcb8281a5241bcb8cd32ab5eaae269 (table test-table [id=1a4b5df1040340f9a0599872a870353e]) successfully deleted
I20260809 02:19:46.561758 19771 tablet_service.cc:1514] Processing DeleteTablet for tablet 3efcb8281a5241bcb8cd32ab5eaae269 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:46 UTC) from {username='oryx', principal='oryx/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:52546
I20260809 02:19:46.561842 20196 tablet_replica.cc:330] T 3efcb8281a5241bcb8cd32ab5eaae269 P 6925c06f0f294640a74692fa04b82858: stopping tablet replica
I20260809 02:19:46.561894 20196 raft_consensus.cc:2229] T 3efcb8281a5241bcb8cd32ab5eaae269 P 6925c06f0f294640a74692fa04b82858 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:46.561937 20196 raft_consensus.cc:2258] T 3efcb8281a5241bcb8cd32ab5eaae269 P 6925c06f0f294640a74692fa04b82858 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:46.562068 19618 catalog_manager.cc:4841] TS 84d6adfff79b472cbc999ba7b69a5e22 (127.11.93.131:36269): tablet 3efcb8281a5241bcb8cd32ab5eaae269 (table test-table [id=1a4b5df1040340f9a0599872a870353e]) successfully deleted
I20260809 02:19:46.562109 19630 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45742:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:19:46.562260 19630 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:19:46.562742 20196 ts_tablet_manager.cc:1905] T 3efcb8281a5241bcb8cd32ab5eaae269 P 6925c06f0f294640a74692fa04b82858: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:46.564168 20196 ts_tablet_manager.cc:1918] T 3efcb8281a5241bcb8cd32ab5eaae269 P 6925c06f0f294640a74692fa04b82858: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:19:46.564232 20196 log.cc:1196] T 3efcb8281a5241bcb8cd32ab5eaae269 P 6925c06f0f294640a74692fa04b82858: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-0/wal/wals/3efcb8281a5241bcb8cd32ab5eaae269
I20260809 02:19:46.564474 20196 ts_tablet_manager.cc:1939] T 3efcb8281a5241bcb8cd32ab5eaae269 P 6925c06f0f294640a74692fa04b82858: Deleting consensus metadata
I20260809 02:19:46.564921 19616 catalog_manager.cc:4841] TS 6925c06f0f294640a74692fa04b82858 (127.11.93.129:46089): tablet 3efcb8281a5241bcb8cd32ab5eaae269 (table test-table [id=1a4b5df1040340f9a0599872a870353e]) successfully deleted
I20260809 02:19:46.565263 19920 tablet_service.cc:1467] Processing CreateTablet for tablet 88e1583a395a44819742456d3adf92c6 (DEFAULT_TABLE table=test-table [id=91eabd19ddac499ab9808af6ae8f6079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:46.565289 20070 tablet_service.cc:1467] Processing CreateTablet for tablet 88e1583a395a44819742456d3adf92c6 (DEFAULT_TABLE table=test-table [id=91eabd19ddac499ab9808af6ae8f6079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:46.565325 19771 tablet_service.cc:1467] Processing CreateTablet for tablet 88e1583a395a44819742456d3adf92c6 (DEFAULT_TABLE table=test-table [id=91eabd19ddac499ab9808af6ae8f6079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:19:46.565395 19920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88e1583a395a44819742456d3adf92c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:46.565395 20070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88e1583a395a44819742456d3adf92c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:46.565429 19771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88e1583a395a44819742456d3adf92c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:46.566661 20171 tablet_bootstrap.cc:492] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22: Bootstrap starting.
I20260809 02:19:46.566672 20172 tablet_bootstrap.cc:492] T 88e1583a395a44819742456d3adf92c6 P d56d1b1e3ff743a18e0933b85c3f6675: Bootstrap starting.
I20260809 02:19:46.567003 20173 tablet_bootstrap.cc:492] T 88e1583a395a44819742456d3adf92c6 P 6925c06f0f294640a74692fa04b82858: Bootstrap starting.
I20260809 02:19:46.567060 20171 tablet_bootstrap.cc:654] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:46.567157 20172 tablet_bootstrap.cc:654] T 88e1583a395a44819742456d3adf92c6 P d56d1b1e3ff743a18e0933b85c3f6675: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:46.567291 20173 tablet_bootstrap.cc:654] T 88e1583a395a44819742456d3adf92c6 P 6925c06f0f294640a74692fa04b82858: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:46.567828 20172 tablet_bootstrap.cc:492] T 88e1583a395a44819742456d3adf92c6 P d56d1b1e3ff743a18e0933b85c3f6675: No bootstrap required, opened a new log
I20260809 02:19:46.567896 20172 ts_tablet_manager.cc:1397] T 88e1583a395a44819742456d3adf92c6 P d56d1b1e3ff743a18e0933b85c3f6675: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:46.568034 20173 tablet_bootstrap.cc:492] T 88e1583a395a44819742456d3adf92c6 P 6925c06f0f294640a74692fa04b82858: No bootstrap required, opened a new log
I20260809 02:19:46.568084 20173 ts_tablet_manager.cc:1397] T 88e1583a395a44819742456d3adf92c6 P 6925c06f0f294640a74692fa04b82858: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 02:19:46.568113 20172 raft_consensus.cc:348] T 88e1583a395a44819742456d3adf92c6 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.568193 20172 raft_consensus.cc:374] T 88e1583a395a44819742456d3adf92c6 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:46.568181 20173 raft_consensus.cc:348] T 88e1583a395a44819742456d3adf92c6 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.568224 20172 raft_consensus.cc:729] T 88e1583a395a44819742456d3adf92c6 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d56d1b1e3ff743a18e0933b85c3f6675, State: Initialized, Role: FOLLOWER
I20260809 02:19:46.568240 20173 raft_consensus.cc:374] T 88e1583a395a44819742456d3adf92c6 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:46.568269 20173 raft_consensus.cc:729] T 88e1583a395a44819742456d3adf92c6 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6925c06f0f294640a74692fa04b82858, State: Initialized, Role: FOLLOWER
I20260809 02:19:46.568274 20172 consensus_queue.cc:260] T 88e1583a395a44819742456d3adf92c6 P d56d1b1e3ff743a18e0933b85c3f6675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.568307 20173 consensus_queue.cc:260] T 88e1583a395a44819742456d3adf92c6 P 6925c06f0f294640a74692fa04b82858 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.568387 20173 ts_tablet_manager.cc:1428] T 88e1583a395a44819742456d3adf92c6 P 6925c06f0f294640a74692fa04b82858: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:46.568387 20172 ts_tablet_manager.cc:1428] T 88e1583a395a44819742456d3adf92c6 P d56d1b1e3ff743a18e0933b85c3f6675: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 02:19:46.568931 20171 tablet_bootstrap.cc:492] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22: No bootstrap required, opened a new log
I20260809 02:19:46.568988 20171 ts_tablet_manager.cc:1397] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 02:19:46.569106 20171 raft_consensus.cc:348] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.569186 20171 raft_consensus.cc:374] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:46.569218 20171 raft_consensus.cc:729] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84d6adfff79b472cbc999ba7b69a5e22, State: Initialized, Role: FOLLOWER
I20260809 02:19:46.569267 20171 consensus_queue.cc:260] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.569377 20171 ts_tablet_manager.cc:1428] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:46.595350 20254 raft_consensus.cc:482] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:19:46.595465 20254 raft_consensus.cc:504] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.595642 20254 leader_election.cc:288] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6925c06f0f294640a74692fa04b82858 (127.11.93.129:46089), d56d1b1e3ff743a18e0933b85c3f6675 (127.11.93.130:45551)
I20260809 02:19:46.595829 19797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88e1583a395a44819742456d3adf92c6" candidate_uuid: "84d6adfff79b472cbc999ba7b69a5e22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6925c06f0f294640a74692fa04b82858" is_pre_election: true
I20260809 02:19:46.595916 19797 raft_consensus.cc:2454] T 88e1583a395a44819742456d3adf92c6 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84d6adfff79b472cbc999ba7b69a5e22 in term 0.
I20260809 02:19:46.595860 19941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88e1583a395a44819742456d3adf92c6" candidate_uuid: "84d6adfff79b472cbc999ba7b69a5e22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" is_pre_election: true
I20260809 02:19:46.595974 19941 raft_consensus.cc:2454] T 88e1583a395a44819742456d3adf92c6 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84d6adfff79b472cbc999ba7b69a5e22 in term 0.
I20260809 02:19:46.596061 20018 leader_election.cc:302] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6925c06f0f294640a74692fa04b82858, 84d6adfff79b472cbc999ba7b69a5e22; no voters:
I20260809 02:19:46.596180 20254 raft_consensus.cc:2781] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:19:46.596215 20254 raft_consensus.cc:482] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:19:46.596235 20254 raft_consensus.cc:3037] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:46.597146 20254 raft_consensus.cc:504] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.597298 20254 leader_election.cc:288] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22 [CANDIDATE]: Term 1 election: Requested vote from peers 6925c06f0f294640a74692fa04b82858 (127.11.93.129:46089), d56d1b1e3ff743a18e0933b85c3f6675 (127.11.93.130:45551)
I20260809 02:19:46.597506 19941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88e1583a395a44819742456d3adf92c6" candidate_uuid: "84d6adfff79b472cbc999ba7b69a5e22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d56d1b1e3ff743a18e0933b85c3f6675"
I20260809 02:19:46.597506 19797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88e1583a395a44819742456d3adf92c6" candidate_uuid: "84d6adfff79b472cbc999ba7b69a5e22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6925c06f0f294640a74692fa04b82858"
I20260809 02:19:46.597594 19797 raft_consensus.cc:3037] T 88e1583a395a44819742456d3adf92c6 P 6925c06f0f294640a74692fa04b82858 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:46.597594 19941 raft_consensus.cc:3037] T 88e1583a395a44819742456d3adf92c6 P d56d1b1e3ff743a18e0933b85c3f6675 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:46.598423 19941 raft_consensus.cc:2454] T 88e1583a395a44819742456d3adf92c6 P d56d1b1e3ff743a18e0933b85c3f6675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84d6adfff79b472cbc999ba7b69a5e22 in term 1.
I20260809 02:19:46.598418 19797 raft_consensus.cc:2454] T 88e1583a395a44819742456d3adf92c6 P 6925c06f0f294640a74692fa04b82858 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84d6adfff79b472cbc999ba7b69a5e22 in term 1.
I20260809 02:19:46.598613 20019 leader_election.cc:302] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84d6adfff79b472cbc999ba7b69a5e22, d56d1b1e3ff743a18e0933b85c3f6675; no voters:
I20260809 02:19:46.598762 20254 raft_consensus.cc:2781] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:46.598831 20254 raft_consensus.cc:686] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22 [term 1 LEADER]: Becoming Leader. State: Replica: 84d6adfff79b472cbc999ba7b69a5e22, State: Running, Role: LEADER
I20260809 02:19:46.598874 20254 consensus_queue.cc:237] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } }
I20260809 02:19:46.599470 19631 catalog_manager.cc:5495] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84d6adfff79b472cbc999ba7b69a5e22 (127.11.93.131). New cstate: current_term: 1 leader_uuid: "84d6adfff79b472cbc999ba7b69a5e22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84d6adfff79b472cbc999ba7b69a5e22" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36269 } health_report { overall_health: HEALTHY } } }
I20260809 02:19:46.612406 20262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:46.609580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:46089 (local address 127.11.93.131:50513)
0809 02:19:46.609728 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:46.609740 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:46.609801 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:46.609931 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:46.609931 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:46.609933 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:19:46.609976 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:46.609978 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.610799 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.610800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:46.611591 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:46.611594 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.612039 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.612040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:46.612088 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:46.612102 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:19:46.612266 (+ 164us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:19:46.612267 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 02:19:46.612303 (+ 36us) client_negotiation.cc:240] Negotiation successful
0809 02:19:46.612341 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":98,"threads_started":1}
I20260809 02:19:46.612401 20168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:46.609650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:50513 (local address 127.11.93.129:46089)
0809 02:19:46.609695 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:46.609698 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:46.609805 (+ 107us) server_negotiation.cc:407] Connection header received
0809 02:19:46.609851 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:46.609852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:46.609864 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:46.609929 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:19:46.610012 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.610694 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.611675 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.611960 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.612027 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:46.612174 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:19:46.612207 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:19:46.612260 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:46.612307 (+ 47us) server_negotiation.cc:299] Negotiation successful
0809 02:19:46.612326 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 02:19:46.614434 19797 raft_consensus.cc:1261] T 88e1583a395a44819742456d3adf92c6 P 6925c06f0f294640a74692fa04b82858 [term 1 FOLLOWER]: Refusing update from remote peer 84d6adfff79b472cbc999ba7b69a5e22: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:46.614625 19941 raft_consensus.cc:1261] T 88e1583a395a44819742456d3adf92c6 P d56d1b1e3ff743a18e0933b85c3f6675 [term 1 FOLLOWER]: Refusing update from remote peer 84d6adfff79b472cbc999ba7b69a5e22: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:19:46.614614 20190 consensus_queue.cc:1035] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6925c06f0f294640a74692fa04b82858" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:46.614830 20190 consensus_queue.cc:1035] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d56d1b1e3ff743a18e0933b85c3f6675" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:19:46.622613 20169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:46.619867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:55647 (local address 127.11.93.131:36269)
0809 02:19:46.619921 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:46.619923 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:46.619931 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:19:46.619952 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:46.619953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:46.619966 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:46.620021 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:19:46.620176 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.620884 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.621782 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.622107 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.622188 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:46.622364 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:19:46.622392 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:19:46.622459 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:46.622525 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 02:19:46.622547 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 02:19:46.622637 20226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:46.619700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:36269 (local address 127.11.93.129:55647)
0809 02:19:46.619765 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:46.619779 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:46.619829 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:46.620039 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:46.620040 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:46.620041 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:19:46.620086 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:46.620087 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.620965 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.620965 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:46.621704 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:46.621707 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:46.622226 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:46.622227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:46.622286 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:46.622293 (+ 7us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:19:46.622461 (+ 168us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:19:46.622465 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:19:46.622520 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 02:19:46.622568 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 02:19:46.634810 19631 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45742:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:46.634944 19631 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45742:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:19:46.635691 19631 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ef548273ab664446820cc479c3a2f124: Sending DeleteTablet for 3 replicas of tablet 88e1583a395a44819742456d3adf92c6
I20260809 02:19:46.635967 19771 tablet_service.cc:1514] Processing DeleteTablet for tablet 88e1583a395a44819742456d3adf92c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:46 UTC) from {username='oryx', principal='oryx/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:52546
I20260809 02:19:46.635977 19920 tablet_service.cc:1514] Processing DeleteTablet for tablet 88e1583a395a44819742456d3adf92c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:46 UTC) from {username='oryx', principal='oryx/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:44530
I20260809 02:19:46.636071 20195 tablet_replica.cc:330] T 88e1583a395a44819742456d3adf92c6 P d56d1b1e3ff743a18e0933b85c3f6675: stopping tablet replica
I20260809 02:19:46.636072 20196 tablet_replica.cc:330] T 88e1583a395a44819742456d3adf92c6 P 6925c06f0f294640a74692fa04b82858: stopping tablet replica
I20260809 02:19:46.636119 20196 raft_consensus.cc:2229] T 88e1583a395a44819742456d3adf92c6 P 6925c06f0f294640a74692fa04b82858 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:46.636127 20195 raft_consensus.cc:2229] T 88e1583a395a44819742456d3adf92c6 P d56d1b1e3ff743a18e0933b85c3f6675 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:19:46.636157 20196 raft_consensus.cc:2258] T 88e1583a395a44819742456d3adf92c6 P 6925c06f0f294640a74692fa04b82858 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:46.636159 20195 raft_consensus.cc:2258] T 88e1583a395a44819742456d3adf92c6 P d56d1b1e3ff743a18e0933b85c3f6675 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:46.636279 20070 tablet_service.cc:1514] Processing DeleteTablet for tablet 88e1583a395a44819742456d3adf92c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:19:46 UTC) from {username='oryx', principal='oryx/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:55608
I20260809 02:19:46.636364 20199 tablet_replica.cc:330] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22: stopping tablet replica
I20260809 02:19:46.636418 20199 raft_consensus.cc:2229] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:19:46.636482 20199 raft_consensus.cc:2258] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:19:46.636562 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 19708
I20260809 02:19:46.638434 20199 ts_tablet_manager.cc:1905] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:46.640254 20199 ts_tablet_manager.cc:1918] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:19:46.640326 20199 log.cc:1196] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/88e1583a395a44819742456d3adf92c6
I20260809 02:19:46.640419 20195 ts_tablet_manager.cc:1905] T 88e1583a395a44819742456d3adf92c6 P d56d1b1e3ff743a18e0933b85c3f6675: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:19:46.640635 20199 ts_tablet_manager.cc:1939] T 88e1583a395a44819742456d3adf92c6 P 84d6adfff79b472cbc999ba7b69a5e22: Deleting consensus metadata
I20260809 02:19:46.640992 19618 catalog_manager.cc:4841] TS 84d6adfff79b472cbc999ba7b69a5e22 (127.11.93.131:36269): tablet 88e1583a395a44819742456d3adf92c6 (table test-table [id=91eabd19ddac499ab9808af6ae8f6079]) successfully deleted
I20260809 02:19:46.641908 20195 ts_tablet_manager.cc:1918] T 88e1583a395a44819742456d3adf92c6 P d56d1b1e3ff743a18e0933b85c3f6675: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:19:46.641981 20195 log.cc:1196] T 88e1583a395a44819742456d3adf92c6 P d56d1b1e3ff743a18e0933b85c3f6675: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/88e1583a395a44819742456d3adf92c6
I20260809 02:19:46.642184 20195 ts_tablet_manager.cc:1939] T 88e1583a395a44819742456d3adf92c6 P d56d1b1e3ff743a18e0933b85c3f6675: Deleting consensus metadata
I20260809 02:19:46.642526 19617 catalog_manager.cc:4841] TS d56d1b1e3ff743a18e0933b85c3f6675 (127.11.93.130:45551): tablet 88e1583a395a44819742456d3adf92c6 (table test-table [id=91eabd19ddac499ab9808af6ae8f6079]) successfully deleted
W20260809 02:19:46.645339 19616 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.93.129:46089 (error 108)
I20260809 02:19:46.645551 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 19855
I20260809 02:19:46.646750 20266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:46.646355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:46089 (local address 127.0.0.1:52580)
0809 02:19:46.646618 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:46.646685 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.129:46089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":181,"threads_started":1}
W20260809 02:19:46.647070 19616 catalog_manager.cc:4584] TS 6925c06f0f294640a74692fa04b82858 (127.11.93.129:46089): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 88e1583a395a44819742456d3adf92c6: Network error: Client connection negotiation failed: client connection to 127.11.93.129:46089: connect: Connection refused (error 111)
I20260809 02:19:46.653079 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 19999
I20260809 02:19:46.659536 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 19596
2026-08-09T02:19:46Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2886 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:19:46 dist-test-slave-w206 krb5kdc[20270](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:19:46 dist-test-slave-w206 krb5kdc[20270](info): set up 2 sockets
Aug 09 02:19:46 dist-test-slave-w206 krb5kdc[20270](info): commencing operation
krb5kdc: starting...
W20260809 02:19:47.774796 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.093s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:19:47 dist-test-slave-w206 krb5kdc[20270](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241987, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:19:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:19:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:19:47.901659 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:34841
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:41545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:34841
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:47.983835 20284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:47.984054 20284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:47.984076 20284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:47.985229 20284 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:19:47.985271 20284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:47.985286 20284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:47.985298 20284 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:19:47.985311 20284 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:19:47.986795 20284 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:41545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:34841
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:34841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20284
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:47.987078 20284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:47.987315 20284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:47.992117 20289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:47.992117 20292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:47.992159 20290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:47.992416 20284 server_base.cc:1034] running on GCE node
I20260809 02:19:47.992661 20284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:47.992946 20284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:47.994102 20284 hybrid_clock.cc:648] HybridClock initialized: now 1786241987994095 us; error 37 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-09T02:19:48Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1338 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:19:48 dist-test-slave-w206 krb5kdc[20297](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:19:48 dist-test-slave-w206 krb5kdc[20297](info): set up 2 sockets
Aug 09 02:19:48 dist-test-slave-w206 krb5kdc[20297](info): commencing operation
krb5kdc: starting...
W20260809 02:19:49.074911 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:19:49 dist-test-slave-w206 krb5kdc[20297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:19:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:19:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:19:49.202550 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:45689
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:43883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:45689
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:49.288228 20311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:49.288477 20311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:49.288517 20311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:49.289721 20311 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:19:49.289803 20311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:49.289831 20311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:49.289861 20311 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:19:49.289889 20311 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:19:49.291438 20311 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:43883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:45689
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:45689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20311
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:49.291711 20311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:49.291939 20311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:49.296921 20317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:49.296947 20321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:49.297096 20311 server_base.cc:1034] running on GCE node
W20260809 02:19:49.296988 20318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:49.297466 20311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:49.297720 20311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:49.298866 20311 hybrid_clock.cc:648] HybridClock initialized: now 1786241989298832 us; error 48 us; skew 500 ppm
Aug 09 02:19:49 dist-test-slave-w206 krb5kdc[20297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241989, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:49.306277 20311 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:19:49.306782 20311 webserver.cc:460] Webserver started at http://127.11.93.190:44467/ using document root <none> and password file <none>
I20260809 02:19:49.307066 20311 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:49.307137 20311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:49.307298 20311 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:49.308358 20311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "04faeaa002cf4a1dbad2519c51d4f30f"
format_stamp: "Formatted at 2026-08-09 02:19:49 on dist-test-slave-w206"
server_key: "406c8534a7a09e26d7e75e2224198156"
server_key_iv: "641a40ec9dfe6667b3686bb6cdbb551b"
server_key_version: "encryptionkey@0"
I20260809 02:19:49.308732 20311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "04faeaa002cf4a1dbad2519c51d4f30f"
format_stamp: "Formatted at 2026-08-09 02:19:49 on dist-test-slave-w206"
server_key: "406c8534a7a09e26d7e75e2224198156"
server_key_iv: "641a40ec9dfe6667b3686bb6cdbb551b"
server_key_version: "encryptionkey@0"
I20260809 02:19:49.310114 20311 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:19:49.310855 20328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:49.311064 20311 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:49.311165 20311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "04faeaa002cf4a1dbad2519c51d4f30f"
format_stamp: "Formatted at 2026-08-09 02:19:49 on dist-test-slave-w206"
server_key: "406c8534a7a09e26d7e75e2224198156"
server_key_iv: "641a40ec9dfe6667b3686bb6cdbb551b"
server_key_version: "encryptionkey@0"
I20260809 02:19:49.311246 20311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:49.325126 20311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:49.327052 20311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:49.327215 20311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:49.331387 20311 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:45689
I20260809 02:19:49.331441 20382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:45689 every 8 connection(s)
I20260809 02:19:49.331825 20311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:19:49.332719 20383 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:19:49.335104 20383 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f: Bootstrap starting.
I20260809 02:19:49.335722 20383 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f: Neither blocks nor log segments found. Creating new log.
I20260809 02:19:49.336030 20383 log.cc:824] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:49.336970 20383 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f: No bootstrap required, opened a new log
I20260809 02:19:49.338105 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 20311
I20260809 02:19:49.338193 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:19:49.338423 11638 external_mini_cluster.cc:1428] Setting key 6a46af1e8d8ab40cfdcd74080e33ab7c
I20260809 02:19:49.338817 20383 raft_consensus.cc:348] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04faeaa002cf4a1dbad2519c51d4f30f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45689 } }
I20260809 02:19:49.339061 20383 raft_consensus.cc:374] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:19:49.339118 20383 raft_consensus.cc:729] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04faeaa002cf4a1dbad2519c51d4f30f, State: Initialized, Role: FOLLOWER
I20260809 02:19:49.339277 20383 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04faeaa002cf4a1dbad2519c51d4f30f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45689 } }
I20260809 02:19:49.339363 20383 raft_consensus.cc:388] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:19:49.339386 20383 raft_consensus.cc:482] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:19:49.339461 20383 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:19:49.340344 20383 raft_consensus.cc:504] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04faeaa002cf4a1dbad2519c51d4f30f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45689 } }
I20260809 02:19:49.340466 20383 leader_election.cc:302] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 04faeaa002cf4a1dbad2519c51d4f30f; no voters:
I20260809 02:19:49.340668 20383 leader_election.cc:288] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:19:49.340703 20388 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:19:49.340811 20388 raft_consensus.cc:686] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [term 1 LEADER]: Becoming Leader. State: Replica: 04faeaa002cf4a1dbad2519c51d4f30f, State: Running, Role: LEADER
I20260809 02:19:49.340891 20388 consensus_queue.cc:237] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04faeaa002cf4a1dbad2519c51d4f30f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45689 } }
I20260809 02:19:49.340943 20383 sys_catalog.cc:564] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:19:49.341264 20388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "04faeaa002cf4a1dbad2519c51d4f30f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04faeaa002cf4a1dbad2519c51d4f30f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45689 } } }
I20260809 02:19:49.341348 20388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:49.341467 20388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04faeaa002cf4a1dbad2519c51d4f30f. Latest consensus state: current_term: 1 leader_uuid: "04faeaa002cf4a1dbad2519c51d4f30f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04faeaa002cf4a1dbad2519c51d4f30f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45689 } } }
I20260809 02:19:49.341536 20388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:49.342201 20392 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:19:49.342698 20392 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:19:49.345228 20392 catalog_manager.cc:1347] Generated new cluster ID: fa8685d5d73344c48c839004508dbb32
I20260809 02:19:49.345284 20392 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 02:19:49 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241989, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:49.349546 20387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:49.339005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53052 (local address 127.11.93.190:45689)
0809 02:19:49.339191 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:49.339201 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:49.339234 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:19:49.339353 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:49.339382 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:49.339441 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:49.339588 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:49.340252 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:49.341776 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:49.342896 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:49.343500 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:49.343613 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:49.346227 (+ 2614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:49.346231 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:49.346231 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:49.346243 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:49.347990 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:49.348380 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:49.348383 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:49.348383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:49.348496 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:49.348712 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:49.348713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:49.348713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:49.348954 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:49.349133 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:49.349202 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 02:19:49.349343 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":84,"threads_started":1}
I20260809 02:19:49.363551 20392 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:19:49.364230 20392 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:19:49.370206 20392 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f: Generated new TSK 0
I20260809 02:19:49.370433 20392 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.93.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
I20260809 02:19:49.409639 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:45689
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:43883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:49.512678 20412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:49.512885 20412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:49.512908 20412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:49.514098 20412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:49.514140 20412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:49.514168 20412 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:19:49.516136 20412 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:43883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:45689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20412
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:49.516444 20412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:49.516731 20412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:49.522094 20418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:49.522145 20417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:49.522121 20421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:49.522274 20412 server_base.cc:1034] running on GCE node
I20260809 02:19:49.522547 20412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:49.522804 20412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:49.523976 20412 hybrid_clock.cc:648] HybridClock initialized: now 1786241989523946 us; error 60 us; skew 500 ppm
Aug 09 02:19:49 dist-test-slave-w206 krb5kdc[20297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241989, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:49.526665 20412 init.cc:377] Logged in from keytab as kudu/127.11.93.129@KRBTEST.COM (short username kudu)
I20260809 02:19:49.527159 20412 webserver.cc:460] Webserver started at http://127.11.93.129:33859/ using document root <none> and password file <none>
I20260809 02:19:49.527388 20412 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:49.527462 20412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:49.527624 20412 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:49.528707 20412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "553eda8406a046d2a09526cdc5872007"
format_stamp: "Formatted at 2026-08-09 02:19:49 on dist-test-slave-w206"
server_key: "82cd4eeeaa5ad91d38df015ce004bd17"
server_key_iv: "839d00ac078b97c63890197e6a3dac85"
server_key_version: "encryptionkey@0"
I20260809 02:19:49.529079 20412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "553eda8406a046d2a09526cdc5872007"
format_stamp: "Formatted at 2026-08-09 02:19:49 on dist-test-slave-w206"
server_key: "82cd4eeeaa5ad91d38df015ce004bd17"
server_key_iv: "839d00ac078b97c63890197e6a3dac85"
server_key_version: "encryptionkey@0"
I20260809 02:19:49.530450 20412 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:19:49.531224 20428 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:49.531407 20412 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:49.531508 20412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "553eda8406a046d2a09526cdc5872007"
format_stamp: "Formatted at 2026-08-09 02:19:49 on dist-test-slave-w206"
server_key: "82cd4eeeaa5ad91d38df015ce004bd17"
server_key_iv: "839d00ac078b97c63890197e6a3dac85"
server_key_version: "encryptionkey@0"
I20260809 02:19:49.531590 20412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:49.555099 20412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:49.557790 20412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:49.557978 20412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:49.558295 20412 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:49.558665 20412 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:49.558736 20412 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:49.558782 20412 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:49.558830 20412 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:49.565354 20412 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:37569
I20260809 02:19:49.565398 20550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:37569 every 8 connection(s)
I20260809 02:19:49.565776 20412 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
Aug 09 02:19:49 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241989, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:49.574779 20387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:49.566597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:38759 (local address 127.11.93.190:45689)
0809 02:19:49.566662 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:49.566664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:49.566846 (+ 182us) server_negotiation.cc:407] Connection header received
0809 02:19:49.567404 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:49.567405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:49.567419 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:49.567477 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:49.568473 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:49.568973 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:49.569918 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:49.570103 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:49.570152 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:49.572235 (+ 2083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:49.572237 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:49.572237 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:49.572243 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:49.573672 (+ 1429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:49.574007 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:49.574008 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:49.574008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:49.574059 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:49.574259 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:49.574259 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:49.574260 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:49.574359 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:49.574421 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:49.574650 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 02:19:49.574714 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 02:19:49.574922 20553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:49.566579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.129:38759)
0809 02:19:49.566740 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:49.566775 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:49.567302 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:49.567528 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:49.567531 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:49.568092 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:49.568279 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:49.568284 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:49.569059 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:49.569060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:49.569842 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:49.569843 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:49.570175 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:49.570176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:49.570274 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:49.570723 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:49.570731 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:49.572150 (+ 1419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:49.573740 (+ 1590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:49.573745 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:49.573746 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:49.573944 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:49.574114 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:49.574115 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:49.574115 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:49.574205 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:49.574429 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:49.574434 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:49.574542 (+ 108us) client_negotiation.cc:769] Sending connection context
0809 02:19:49.574621 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 02:19:49.574732 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":93,"threads_started":1}
I20260809 02:19:49.575433 20551 heartbeater.cc:347] Connected to a master server at 127.11.93.190:45689
I20260809 02:19:49.575537 20551 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:49.575708 20551 heartbeater.cc:511] Master 127.11.93.190:45689 requested a full tablet report, sending...
I20260809 02:19:49.576004 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 20412
I20260809 02:19:49.576118 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:19:49.576283 11638 external_mini_cluster.cc:1428] Setting key a8e764c48070f33712f52b76ca2e973d
I20260809 02:19:49.576270 20346 ts_manager.cc:194] Registered new tserver with Master: 553eda8406a046d2a09526cdc5872007 (127.11.93.129:37569)
I20260809 02:19:49.576958 20346 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:38759
WARNING: no policy specified for kudu/127.11.93.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
I20260809 02:19:49.602205 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:45689
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:43883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:49.684362 20556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:49.684582 20556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:49.684605 20556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:49.685778 20556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:49.685822 20556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:49.685849 20556 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:19:49.687408 20556 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:43883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:45689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:49.687654 20556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:49.687878 20556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:49.692907 20564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:49.692922 20562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:49.692919 20561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:49.693022 20556 server_base.cc:1034] running on GCE node
I20260809 02:19:49.693361 20556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:49.693674 20556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:49.694819 20556 hybrid_clock.cc:648] HybridClock initialized: now 1786241989694792 us; error 43 us; skew 500 ppm
Aug 09 02:19:49 dist-test-slave-w206 krb5kdc[20297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241989, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:49.697358 20556 init.cc:377] Logged in from keytab as kudu/127.11.93.130@KRBTEST.COM (short username kudu)
I20260809 02:19:49.697837 20556 webserver.cc:460] Webserver started at http://127.11.93.130:41531/ using document root <none> and password file <none>
I20260809 02:19:49.698074 20556 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:49.698120 20556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:49.698287 20556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:49.699405 20556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "8213620c57c34870a033615869dbf679"
format_stamp: "Formatted at 2026-08-09 02:19:49 on dist-test-slave-w206"
server_key: "d892dd0d18ce25e4932f9a4e60dfeb49"
server_key_iv: "af6ae430986a40117fe182717c8ecc1e"
server_key_version: "encryptionkey@0"
I20260809 02:19:49.699757 20556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "8213620c57c34870a033615869dbf679"
format_stamp: "Formatted at 2026-08-09 02:19:49 on dist-test-slave-w206"
server_key: "d892dd0d18ce25e4932f9a4e60dfeb49"
server_key_iv: "af6ae430986a40117fe182717c8ecc1e"
server_key_version: "encryptionkey@0"
I20260809 02:19:49.701115 20556 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:19:49.701898 20571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:49.702121 20556 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:49.702194 20556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "8213620c57c34870a033615869dbf679"
format_stamp: "Formatted at 2026-08-09 02:19:49 on dist-test-slave-w206"
server_key: "d892dd0d18ce25e4932f9a4e60dfeb49"
server_key_iv: "af6ae430986a40117fe182717c8ecc1e"
server_key_version: "encryptionkey@0"
I20260809 02:19:49.702239 20556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:49.733275 20556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:49.735834 20556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:49.735992 20556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:49.736253 20556 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:49.736606 20556 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:49.736670 20556 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:49.736706 20556 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:49.736733 20556 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:49.742895 20556 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:39605
I20260809 02:19:49.742960 20693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:39605 every 8 connection(s)
I20260809 02:19:49.743279 20556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:19:49.747886 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 20556
I20260809 02:19:49.748010 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:19:49.748230 11638 external_mini_cluster.cc:1428] Setting key f2b8f72732e40fceb905b0644af5c163
Aug 09 02:19:49 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241989, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:49.753054 20387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:49.743994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:47177 (local address 127.11.93.190:45689)
0809 02:19:49.744068 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:49.744070 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:49.744369 (+ 299us) server_negotiation.cc:407] Connection header received
0809 02:19:49.744914 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:49.744915 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:49.744928 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:49.744970 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:49.745958 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:49.746466 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:49.747527 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:49.747734 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:49.747820 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:49.750122 (+ 2302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:49.750123 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:49.750124 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:49.750131 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:49.751580 (+ 1449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:49.752088 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:49.752089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:49.752089 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:49.752151 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:49.752439 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:49.752440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:49.752440 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:49.752546 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:49.752601 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:49.752910 (+ 309us) server_negotiation.cc:299] Negotiation successful
0809 02:19:49.752987 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 02:19:49.753394 20697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:49.743976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.130:47177)
0809 02:19:49.744154 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:49.744246 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:49.744796 (+ 550us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:49.745064 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:49.745067 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:49.745661 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:49.745850 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:49.745855 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:49.746562 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:49.746563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:49.747424 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:49.747426 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:49.747830 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:49.747831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:49.747980 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:49.748561 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:49.748569 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:49.750021 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:49.751682 (+ 1661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:49.751689 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:49.751691 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:49.752000 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:49.752231 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:49.752232 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:49.752232 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:49.752374 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:49.752610 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:49.752616 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:49.752774 (+ 158us) client_negotiation.cc:769] Sending connection context
0809 02:19:49.752888 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 02:19:49.753091 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":83,"threads_started":1}
I20260809 02:19:49.753880 20695 heartbeater.cc:347] Connected to a master server at 127.11.93.190:45689
I20260809 02:19:49.753966 20695 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:49.754158 20695 heartbeater.cc:511] Master 127.11.93.190:45689 requested a full tablet report, sending...
I20260809 02:19:49.754570 20346 ts_manager.cc:194] Registered new tserver with Master: 8213620c57c34870a033615869dbf679 (127.11.93.130:39605)
I20260809 02:19:49.754948 20346 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:47177
WARNING: no policy specified for kudu/127.11.93.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
I20260809 02:19:49.777460 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:45689
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:43883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:49.860710 20700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:49.860917 20700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:49.860941 20700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:49.862131 20700 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:49.862176 20700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:49.862203 20700 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:19:49.863729 20700 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:43883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:45689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20700
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:49.863987 20700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:49.864223 20700 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:49.869359 20705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:49.869444 20708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:49.869491 20706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:49.869509 20700 server_base.cc:1034] running on GCE node
I20260809 02:19:49.869938 20700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:49.870230 20700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:49.871420 20700 hybrid_clock.cc:648] HybridClock initialized: now 1786241989871401 us; error 43 us; skew 500 ppm
Aug 09 02:19:49 dist-test-slave-w206 krb5kdc[20297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241989, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:49.874190 20700 init.cc:377] Logged in from keytab as kudu/127.11.93.131@KRBTEST.COM (short username kudu)
I20260809 02:19:49.874667 20700 webserver.cc:460] Webserver started at http://127.11.93.131:38227/ using document root <none> and password file <none>
I20260809 02:19:49.874854 20700 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:49.874897 20700 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:49.875051 20700 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:19:49.876068 20700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "b5547aea83854dccb9aa09d8adf78b48"
format_stamp: "Formatted at 2026-08-09 02:19:49 on dist-test-slave-w206"
server_key: "2891586ff493511dc832a4136ef192c0"
server_key_iv: "3c3de04c617328644fa89e7f1569e3ef"
server_key_version: "encryptionkey@0"
I20260809 02:19:49.876371 20700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "b5547aea83854dccb9aa09d8adf78b48"
format_stamp: "Formatted at 2026-08-09 02:19:49 on dist-test-slave-w206"
server_key: "2891586ff493511dc832a4136ef192c0"
server_key_iv: "3c3de04c617328644fa89e7f1569e3ef"
server_key_version: "encryptionkey@0"
I20260809 02:19:49.877671 20700 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 02:19:49.878374 20715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:49.878551 20700 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:19:49.878641 20700 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "b5547aea83854dccb9aa09d8adf78b48"
format_stamp: "Formatted at 2026-08-09 02:19:49 on dist-test-slave-w206"
server_key: "2891586ff493511dc832a4136ef192c0"
server_key_iv: "3c3de04c617328644fa89e7f1569e3ef"
server_key_version: "encryptionkey@0"
I20260809 02:19:49.878696 20700 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:49.928896 20700 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:49.930830 20700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:49.930948 20700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:49.931176 20700 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:49.931531 20700 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:49.931566 20700 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:49.931589 20700 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:49.931641 20700 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:49.937557 20700 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:38377
I20260809 02:19:49.937644 20832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:38377 every 8 connection(s)
I20260809 02:19:49.937981 20700 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:19:49.943150 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 20700
I20260809 02:19:49.943265 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:19:49.943488 11638 external_mini_cluster.cc:1428] Setting key 02bb7245deb97b37e2188e3944dbb8ea
Aug 09 02:19:49 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241989, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:19:49.947654 20387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:49.938779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:59011 (local address 127.11.93.190:45689)
0809 02:19:49.938868 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:49.938870 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:49.939058 (+ 188us) server_negotiation.cc:407] Connection header received
0809 02:19:49.939604 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:49.939605 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:49.939616 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:49.939668 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:49.940710 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:49.941264 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:49.942377 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:49.942567 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:49.942622 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:49.945068 (+ 2446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:49.945070 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:49.945070 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:49.945076 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:49.946480 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:49.946819 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:49.946820 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:49.946820 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:49.946871 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:49.947140 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:49.947141 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:49.947141 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:49.947245 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:49.947301 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:49.947528 (+ 227us) server_negotiation.cc:299] Negotiation successful
0809 02:19:49.947589 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:19:49.947824 20835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:49.938700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.131:59011)
0809 02:19:49.938905 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:49.938941 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:49.939494 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:49.939740 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:49.939743 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:49.940400 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:49.940599 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:49.940604 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:49.941364 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:49.941365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:49.942301 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:49.942303 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:49.942639 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:49.942640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:49.942740 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:49.943303 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:49.943313 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:49.944983 (+ 1670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:19:49.946549 (+ 1566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:49.946553 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:49.946555 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:49.946757 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:49.946926 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:19:49.946927 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:19:49.946927 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:19:49.947083 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:19:49.947304 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:19:49.947308 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:19:49.947417 (+ 109us) client_negotiation.cc:769] Sending connection context
0809 02:19:49.947492 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 02:19:49.947605 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":112,"threads_started":1}
I20260809 02:19:49.948293 20833 heartbeater.cc:347] Connected to a master server at 127.11.93.190:45689
I20260809 02:19:49.948390 20833 heartbeater.cc:464] Registering TS with master...
I20260809 02:19:49.948530 20833 heartbeater.cc:511] Master 127.11.93.190:45689 requested a full tablet report, sending...
I20260809 02:19:49.948879 20346 ts_manager.cc:194] Registered new tserver with Master: b5547aea83854dccb9aa09d8adf78b48 (127.11.93.131:38377)
I20260809 02:19:49.949210 20346 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:59011
I20260809 02:19:49.955386 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.93.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.93.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.93.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.129.keytab.
Entry for principal oryx/127.11.93.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.129.keytab.
WARNING: no policy specified for oryx/127.11.93.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.93.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.93.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.130.keytab.
Entry for principal oryx/127.11.93.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.130.keytab.
WARNING: no policy specified for oryx/127.11.93.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.93.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.93.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.131.keytab.
Entry for principal oryx/127.11.93.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.131.keytab.
I20260809 02:19:50.029887 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 20412
I20260809 02:19:50.035938 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 20556
I20260809 02:19:50.041131 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 20700
I20260809 02:19:50.046334 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 20311
I20260809 02:19:50.052698 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:45689
--webserver_interface=127.11.93.190
--webserver_port=44467
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:43883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:45689
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:19:50.135151 20843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:50.135353 20843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:50.135376 20843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:50.136543 20843 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:19:50.136590 20843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:50.136605 20843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:50.136617 20843 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:19:50.136667 20843 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:19:50.138209 20843 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:43883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:45689
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:45689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=44467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:50.138473 20843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:50.138710 20843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:50.143663 20851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:50.143653 20848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:50.143653 20849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:50.143884 20843 server_base.cc:1034] running on GCE node
I20260809 02:19:50.144109 20843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:50.144362 20843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:50.145511 20843 hybrid_clock.cc:648] HybridClock initialized: now 1786241990145502 us; error 32 us; skew 500 ppm
Aug 09 02:19:50 dist-test-slave-w206 krb5kdc[20297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241990, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:50.148075 20843 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:19:50.148551 20843 webserver.cc:460] Webserver started at http://127.11.93.190:44467/ using document root <none> and password file <none>
I20260809 02:19:50.148808 20843 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:50.148898 20843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:50.150418 20843 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 02:19:50.151165 20858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:50.151346 20843 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:19:50.151436 20843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "04faeaa002cf4a1dbad2519c51d4f30f"
format_stamp: "Formatted at 2026-08-09 02:19:49 on dist-test-slave-w206"
server_key: "406c8534a7a09e26d7e75e2224198156"
server_key_iv: "641a40ec9dfe6667b3686bb6cdbb551b"
server_key_version: "encryptionkey@0"
I20260809 02:19:50.151798 20843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:50.168980 20843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:50.171044 20843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:50.171216 20843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:50.175311 20843 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:45689
I20260809 02:19:50.175352 20912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:45689 every 8 connection(s)
I20260809 02:19:50.175779 20843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:19:50.177314 20913 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:19:50.177979 20913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f: Bootstrap starting.
I20260809 02:19:50.178078 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 20843
I20260809 02:19:50.178416 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:37569
--local_ip_for_outbound_sockets=127.11.93.129
--tserver_master_addrs=127.11.93.190:45689
--webserver_port=33859
--webserver_interface=127.11.93.129
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:43883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.93.129
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:19:50.187160 20913 log.cc:824] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f: Log is configured to *not* fsync() on all Append() calls
I20260809 02:19:50.188956 20913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:19:50.189256 20913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f: Bootstrap complete.
I20260809 02:19:50.191674 20913 raft_consensus.cc:348] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04faeaa002cf4a1dbad2519c51d4f30f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45689 } }
I20260809 02:19:50.191929 20913 raft_consensus.cc:729] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04faeaa002cf4a1dbad2519c51d4f30f, State: Initialized, Role: FOLLOWER
I20260809 02:19:50.192145 20913 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04faeaa002cf4a1dbad2519c51d4f30f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45689 } }
I20260809 02:19:50.192245 20913 raft_consensus.cc:388] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:19:50.192299 20913 raft_consensus.cc:482] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:19:50.192346 20913 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [term 1 FOLLOWER]: Advancing to term 2
I20260809 02:19:50.193794 20913 raft_consensus.cc:504] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04faeaa002cf4a1dbad2519c51d4f30f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45689 } }
I20260809 02:19:50.193914 20913 leader_election.cc:302] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 04faeaa002cf4a1dbad2519c51d4f30f; no voters:
I20260809 02:19:50.194108 20913 leader_election.cc:288] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 02:19:50.194147 20919 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [term 2 FOLLOWER]: Leader election won for term 2
I20260809 02:19:50.194272 20919 raft_consensus.cc:686] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [term 2 LEADER]: Becoming Leader. State: Replica: 04faeaa002cf4a1dbad2519c51d4f30f, State: Running, Role: LEADER
I20260809 02:19:50.194404 20913 sys_catalog.cc:564] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:19:50.194427 20919 consensus_queue.cc:237] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04faeaa002cf4a1dbad2519c51d4f30f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45689 } }
I20260809 02:19:50.194706 20919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04faeaa002cf4a1dbad2519c51d4f30f. Latest consensus state: current_term: 2 leader_uuid: "04faeaa002cf4a1dbad2519c51d4f30f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04faeaa002cf4a1dbad2519c51d4f30f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45689 } } }
I20260809 02:19:50.194782 20919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:50.194712 20920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "04faeaa002cf4a1dbad2519c51d4f30f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04faeaa002cf4a1dbad2519c51d4f30f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 45689 } } }
I20260809 02:19:50.194958 20920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f [sys.catalog]: This master's current role is: LEADER
I20260809 02:19:50.195017 20924 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:19:50.195538 20924 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:19:50.195694 20924 catalog_manager.cc:1259] Loaded cluster ID: fa8685d5d73344c48c839004508dbb32
I20260809 02:19:50.195767 20924 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:19:50.197225 20924 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:19:50.197431 20924 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 04faeaa002cf4a1dbad2519c51d4f30f: Loaded TSK: 0
I20260809 02:19:50.197643 20924 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 02:19:50.269296 20915 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:50.269491 20915 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:50.269515 20915 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:50.270678 20915 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:50.270722 20915 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:50.270748 20915 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:19:50.272243 20915 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:43883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.129.keytab
--principal=oryx/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:37569
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=33859
--tserver_master_addrs=127.11.93.190:45689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20915
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:50.272485 20915 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:50.272724 20915 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:50.278594 20946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:50.278560 20945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:50.278818 20915 server_base.cc:1034] running on GCE node
W20260809 02:19:50.278563 20948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:50.279155 20915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:50.279407 20915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:50.280572 20915 hybrid_clock.cc:648] HybridClock initialized: now 1786241990280552 us; error 35 us; skew 500 ppm
Aug 09 02:19:50 dist-test-slave-w206 krb5kdc[20297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241990, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:50.283329 20915 init.cc:377] Logged in from keytab as oryx/127.11.93.129@KRBTEST.COM (short username oryx)
I20260809 02:19:50.283907 20915 webserver.cc:460] Webserver started at http://127.11.93.129:33859/ using document root <none> and password file <none>
I20260809 02:19:50.284211 20915 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:50.284315 20915 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:50.286100 20915 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 02:19:50.286791 20955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:50.287050 20915 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 02:19:50.287146 20915 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "553eda8406a046d2a09526cdc5872007"
format_stamp: "Formatted at 2026-08-09 02:19:49 on dist-test-slave-w206"
server_key: "82cd4eeeaa5ad91d38df015ce004bd17"
server_key_iv: "839d00ac078b97c63890197e6a3dac85"
server_key_version: "encryptionkey@0"
I20260809 02:19:50.287591 20915 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:50.302084 20915 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:50.304683 20915 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:50.304855 20915 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:50.305130 20915 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:50.305510 20915 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:50.305560 20915 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:50.305593 20915 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:50.305621 20915 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:50.313136 20915 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:37569
I20260809 02:19:50.313171 21072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:37569 every 8 connection(s)
I20260809 02:19:50.313606 20915 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:19:50.314538 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 20915
I20260809 02:19:50.314851 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:39605
--local_ip_for_outbound_sockets=127.11.93.130
--tserver_master_addrs=127.11.93.190:45689
--webserver_port=41531
--webserver_interface=127.11.93.130
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:43883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.93.130
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:19:50 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:50 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:50.324877 21076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:50.314398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.129:54903)
0809 02:19:50.314770 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:50.314803 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:50.315493 (+ 690us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:50.315946 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:50.315950 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:50.316628 (+ 678us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:50.316915 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:50.316922 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.318640 (+ 1718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.318642 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:50.320105 (+ 1463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:50.320109 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.320954 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.320955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:50.321133 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:50.321799 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:50.321810 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:50.324675 (+ 2865us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":83,"threads_started":1}
W20260809 02:19:50.325495 21073 heartbeater.cc:644] Failed to heartbeat to 127.11.93.190:45689 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.93.190:45689: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
W20260809 02:19:50.326248 21077 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:50.314440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:54903 (local address 127.11.93.190:45689)
0809 02:19:50.314680 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:50.314688 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:50.314921 (+ 233us) server_negotiation.cc:407] Connection header received
0809 02:19:50.315714 (+ 793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:50.315719 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:50.315766 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:50.315894 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:50.317067 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.318506 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.320208 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.320818 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.320942 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:50.324862 (+ 3920us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.129:54903: BlockingRecv error: recv got EOF from 127.11.93.129:54903 (error 108)
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":72,"threads_started":1}
Aug 09 02:19:50 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:50 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:50.331606 21076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:50.325749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.129:38171)
0809 02:19:50.325830 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:50.325844 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:50.325892 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:50.326183 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:50.326184 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:50.326334 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:50.326387 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:50.326389 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.327438 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.327439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:50.328273 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:50.328275 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.328796 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.328797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:50.328863 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:50.329337 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:50.329342 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:50.331511 (+ 2169us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 02:19:50.332283 21081 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:50.325885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:38171 (local address 127.11.93.190:45689)
0809 02:19:50.326051 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:50.326053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:50.326061 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:19:50.326082 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:50.326082 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:50.326093 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:50.326467 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:50.326509 (+ 42us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.327336 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.328368 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.328703 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.328791 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:50.331607 (+ 2816us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.129:38171: BlockingRecv error: recv got EOF from 127.11.93.129:38171 (error 108)
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":93,"threads_started":1}
Aug 09 02:19:50 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:50 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:50.337061 21076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:50.331995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.129:51567)
0809 02:19:50.332058 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:50.332070 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:50.332116 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:50.332248 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:50.332249 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:50.332401 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:50.332436 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:50.332437 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.333257 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.333259 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:50.334065 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:50.334067 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.334526 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.334527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:50.334581 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:50.335104 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:50.335109 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:50.336993 (+ 1884us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 02:19:50.337163 21077 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:50.332090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:51567 (local address 127.11.93.190:45689)
0809 02:19:50.332124 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:50.332126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:50.332135 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:19:50.332170 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:50.332170 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:50.332181 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:50.332231 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:50.332522 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.333159 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.334150 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.334453 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.334518 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:50.337112 (+ 2594us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.129:51567: BlockingRecv error: recv got EOF from 127.11.93.129:51567 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260809 02:19:50.337406 21073 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:19:50.406231 21078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:50.406491 21078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:50.406531 21078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:50.407804 21078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:50.407876 21078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:50.407923 21078 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:19:50.409418 21078 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:43883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.130.keytab
--principal=oryx/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:39605
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=41531
--tserver_master_addrs=127.11.93.190:45689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:50.409682 21078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:50.409917 21078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:50.415131 21087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:50.415143 21090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:50.415299 21078 server_base.cc:1034] running on GCE node
W20260809 02:19:50.415412 21088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:50.415673 21078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:50.415936 21078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:50.417100 21078 hybrid_clock.cc:648] HybridClock initialized: now 1786241990417082 us; error 42 us; skew 500 ppm
Aug 09 02:19:50 dist-test-slave-w206 krb5kdc[20297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241990, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:50.419966 21078 init.cc:377] Logged in from keytab as oryx/127.11.93.130@KRBTEST.COM (short username oryx)
I20260809 02:19:50.420552 21078 webserver.cc:460] Webserver started at http://127.11.93.130:41531/ using document root <none> and password file <none>
I20260809 02:19:50.420859 21078 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:50.420950 21078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:50.422860 21078 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:19:50.423614 21098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:50.423846 21078 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:19:50.423946 21078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "8213620c57c34870a033615869dbf679"
format_stamp: "Formatted at 2026-08-09 02:19:49 on dist-test-slave-w206"
server_key: "d892dd0d18ce25e4932f9a4e60dfeb49"
server_key_iv: "af6ae430986a40117fe182717c8ecc1e"
server_key_version: "encryptionkey@0"
I20260809 02:19:50.424496 21078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:50.444577 21078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:50.447335 21078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:50.447501 21078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:50.447793 21078 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:50.448211 21078 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:50.448391 21078 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:50.448483 21078 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:50.448514 21078 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:50.457294 21078 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:39605
I20260809 02:19:50.457321 21217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:39605 every 8 connection(s)
I20260809 02:19:50.457845 21078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:19:50.461319 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 21078
I20260809 02:19:50.461629 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:38377
--local_ip_for_outbound_sockets=127.11.93.131
--tserver_master_addrs=127.11.93.190:45689
--webserver_port=38227
--webserver_interface=127.11.93.131
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:43883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.93.131
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:19:50 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:50 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
W20260809 02:19:50.468750 21077 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:50.458666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:52145 (local address 127.11.93.190:45689)
0809 02:19:50.458744 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:50.458746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:50.459020 (+ 274us) server_negotiation.cc:407] Connection header received
0809 02:19:50.459948 (+ 928us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:50.459949 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:50.459964 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:50.460004 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:50.461472 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.462316 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.464065 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.464376 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.464469 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:50.468646 (+ 4177us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.130:52145: BlockingRecv error: recv got EOF from 127.11.93.130:52145 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:19:50.468765 21220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:50.458637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.130:52145)
0809 02:19:50.458851 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:50.458904 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:50.459797 (+ 893us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:50.460113 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:50.460117 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:50.461025 (+ 908us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:50.461327 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:50.461334 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.462452 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.462453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:50.463954 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:50.463958 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.464492 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.464493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:50.464661 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:50.465310 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:50.465321 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:50.468519 (+ 3198us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":104,"threads_started":1}
W20260809 02:19:50.469367 21218 heartbeater.cc:644] Failed to heartbeat to 127.11.93.190:45689 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.93.190:45689: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Aug 09 02:19:50 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:50 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:50.475555 21220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:50.469634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.130:55455)
0809 02:19:50.469683 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:50.469694 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:50.469739 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:50.469905 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:50.469907 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:50.470070 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:50.470128 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:50.470131 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.471146 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.471147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:50.472059 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:50.472062 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.472587 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.472588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:50.472670 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:50.473198 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:50.473203 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:50.475485 (+ 2282us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 02:19:50.475713 21077 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:50.469704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:55455 (local address 127.11.93.190:45689)
0809 02:19:50.469751 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:50.469753 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:50.469764 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:19:50.469793 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:50.469794 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:50.469808 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:50.469888 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:50.470214 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.471053 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.472155 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.472493 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.472578 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:50.475614 (+ 3036us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.130:55455: BlockingRecv error: recv got EOF from 127.11.93.130:55455 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 09 02:19:50 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:50 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:50.481662 21220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:50.476110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.130:44501)
0809 02:19:50.476241 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:50.476251 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:50.476295 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:50.476452 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:50.476453 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:50.476593 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:50.476625 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:50.476626 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.477622 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.477622 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:50.478419 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:50.478421 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.478938 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.478939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:50.479018 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:50.479496 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:50.479501 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:50.481591 (+ 2090us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":92,"threads_started":1}
W20260809 02:19:50.481807 21077 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:50.476188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:44501 (local address 127.11.93.190:45689)
0809 02:19:50.476228 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:50.476230 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:50.476301 (+ 71us) server_negotiation.cc:407] Connection header received
0809 02:19:50.476358 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:50.476360 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:50.476372 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:50.476441 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:50.476700 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.477517 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.478506 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.478849 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.478934 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:50.481725 (+ 2791us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.130:44501: BlockingRecv error: recv got EOF from 127.11.93.130:44501 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260809 02:19:50.482076 21218 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:19:50.550540 21222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:19:50.550768 21222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:19:50.550805 21222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:19:50.551992 21222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:19:50.552063 21222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:19:50.552110 21222 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:19:50.553547 21222 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:43883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/krb5kdc/oryx_127.11.93.131.keytab
--principal=oryx/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:38377
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=38227
--tserver_master_addrs=127.11.93.190:45689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:19:50.553817 21222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:19:50.554100 21222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:19:50.559098 21228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:50.559074 21229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:19:50.559087 21231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:19:50.559297 21222 server_base.cc:1034] running on GCE node
I20260809 02:19:50.559497 21222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:19:50.559685 21222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:19:50.560827 21222 hybrid_clock.cc:648] HybridClock initialized: now 1786241990560806 us; error 37 us; skew 500 ppm
Aug 09 02:19:50 dist-test-slave-w206 krb5kdc[20297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786241990, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:19:50.563347 21222 init.cc:377] Logged in from keytab as oryx/127.11.93.131@KRBTEST.COM (short username oryx)
I20260809 02:19:50.563800 21222 webserver.cc:460] Webserver started at http://127.11.93.131:38227/ using document root <none> and password file <none>
I20260809 02:19:50.564070 21222 fs_manager.cc:359] Metadata directory not provided
I20260809 02:19:50.564152 21222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:19:50.565454 21222 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:19:50.565995 21238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:50.566191 21222 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:50.566293 21222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "b5547aea83854dccb9aa09d8adf78b48"
format_stamp: "Formatted at 2026-08-09 02:19:49 on dist-test-slave-w206"
server_key: "2891586ff493511dc832a4136ef192c0"
server_key_iv: "3c3de04c617328644fa89e7f1569e3ef"
server_key_version: "encryptionkey@0"
I20260809 02:19:50.566619 21222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:19:50.580544 21222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:19:50.582437 21222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:19:50.582597 21222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:19:50.582830 21222 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:19:50.583230 21222 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:19:50.583292 21222 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:50.583336 21222 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:19:50.583364 21222 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:19:50.589355 21222 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:38377
I20260809 02:19:50.589442 21360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:38377 every 8 connection(s)
I20260809 02:19:50.589779 21222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
Aug 09 02:19:50 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:50 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
W20260809 02:19:50.597195 21077 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:50.590526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:36925 (local address 127.11.93.190:45689)
0809 02:19:50.590600 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:50.590602 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:50.590824 (+ 222us) server_negotiation.cc:407] Connection header received
0809 02:19:50.591325 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:50.591326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:50.591336 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:50.591374 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:50.592348 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.592850 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.593877 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.594055 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.594107 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:50.597148 (+ 3041us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.131:36925: BlockingRecv error: recv got EOF from 127.11.93.131:36925 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:19:50.597210 21363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:50.590517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.131:36925)
0809 02:19:50.590698 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:50.590733 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:50.591227 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:50.591452 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:50.591455 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:50.592080 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:50.592273 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:50.592278 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.592928 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.592929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:50.593811 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:50.593814 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.594126 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.594127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:50.594225 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:50.594802 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:50.594815 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:50.597063 (+ 2248us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":104,"threads_started":1}
W20260809 02:19:50.597509 21361 heartbeater.cc:644] Failed to heartbeat to 127.11.93.190:45689 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.93.190:45689: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
I20260809 02:19:50.597781 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 21222
Aug 09 02:19:50 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:50 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:50.603102 21363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:50.597781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.131:35817)
0809 02:19:50.597838 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:50.597850 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:50.597916 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:50.598142 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:50.598143 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:50.598266 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:50.598340 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:50.598342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.599107 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.599108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:50.599671 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:50.599674 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.599999 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.600000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:50.600068 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:50.600446 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:50.600452 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:50.603020 (+ 2568us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 02:19:50.603163 21077 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:50.597953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:35817 (local address 127.11.93.190:45689)
0809 02:19:50.597992 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:50.597994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:50.598023 (+ 29us) server_negotiation.cc:407] Connection header received
0809 02:19:50.598048 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:50.598049 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:50.598059 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:50.598119 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:50.598454 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.599042 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.599754 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.599931 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.599979 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:50.603100 (+ 3121us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.131:35817: BlockingRecv error: recv got EOF from 127.11.93.131:35817 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 02:19:50.605326 21081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:50.598371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53064 (local address 127.11.93.190:45689)
0809 02:19:50.598427 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:50.598429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:50.598437 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:19:50.598504 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:50.598504 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:50.598514 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:50.598574 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:50.599186 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.599606 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.600648 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.600836 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.600888 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:50.602070 (+ 1182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:19:50.602074 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:19:50.602074 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:19:50.602084 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:19:50.603921 (+ 1837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:50.604296 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:50.604304 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:50.604305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:50.604393 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:19:50.604604 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:19:50.604605 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:19:50.604605 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:19:50.604833 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:19:50.604996 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 02:19:50.605095 (+ 99us) server_negotiation.cc:299] Negotiation successful
0809 02:19:50.605206 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
Aug 09 02:19:50 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:50 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:50.607590 21363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:50.603469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.131:37751)
0809 02:19:50.603501 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:50.603511 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:50.603546 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:50.603669 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:50.603670 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:50.603805 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:50.603828 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:50.603829 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.604443 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.604444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:50.604924 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:50.604926 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.605308 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.605309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:50.605371 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:50.605768 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:50.605772 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:50.607548 (+ 1776us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":17}
W20260809 02:19:50.607721 21077 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:50.603530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:37751 (local address 127.11.93.190:45689)
0809 02:19:50.603572 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:50.603574 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:50.603581 (+ 7us) server_negotiation.cc:407] Connection header received
0809 02:19:50.603601 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:50.603602 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:50.603610 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:50.603665 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:50.603912 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.604358 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.605016 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:50.605233 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:50.605296 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:50.607651 (+ 2355us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.131:37751: BlockingRecv error: recv got EOF from 127.11.93.131:37751 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260809 02:19:50.607712 21361 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 09 02:19:51 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:51 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:51.342519 21365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:51.337758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.129:48597)
0809 02:19:51.337906 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:51.337917 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:51.337969 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:51.338111 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:51.338112 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:51.338288 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:51.338339 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:51.338340 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:51.339096 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:51.339098 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:51.339734 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:51.339737 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:51.340109 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:51.340110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:51.340161 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:51.340658 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:51.340664 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:51.342449 (+ 1785us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":84,"threads_started":1}
W20260809 02:19:51.342593 21366 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:51.337862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:48597 (local address 127.11.93.190:45689)
0809 02:19:51.337986 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:51.337990 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:51.338003 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:19:51.338027 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:51.338028 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:51.338037 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:51.338097 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:51.338419 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:51.338916 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:51.339819 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:51.340024 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:51.340079 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:51.342538 (+ 2459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.129:48597: BlockingRecv error: recv got EOF from 127.11.93.129:48597 (error 108)
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":73,"threads_started":1}
Aug 09 02:19:51 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:51 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:51.487203 21367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:51.482501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.130:56815)
0809 02:19:51.482662 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:51.482672 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:51.482727 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:51.482851 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:51.482851 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:51.483091 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:51.483142 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:51.483144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:51.483771 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:51.483772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:51.484348 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:51.484350 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:51.484711 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:51.484711 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:51.484751 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:51.485173 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:51.485178 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:51.487135 (+ 1957us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":86,"threads_started":1}
W20260809 02:19:51.487421 21366 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:51.482597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:56815 (local address 127.11.93.190:45689)
0809 02:19:51.482655 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:51.482657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:51.482715 (+ 58us) server_negotiation.cc:407] Connection header received
0809 02:19:51.482773 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:51.482774 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:51.482784 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:51.482845 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:51.483210 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:51.483700 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:51.484449 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:51.484643 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:51.484699 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:51.487331 (+ 2632us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.130:56815: BlockingRecv error: recv got EOF from 127.11.93.130:56815 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 09 02:19:51 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:51 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:51.613008 21368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:51.608141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.131:40519)
0809 02:19:51.608301 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:51.608317 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:51.608392 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:51.608603 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:51.608604 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:51.608802 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:51.608851 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:51.608853 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:51.609542 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:51.609544 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:51.610092 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:51.610094 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:51.610496 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:51.610497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:51.610557 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:51.611070 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:51.611075 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:51.612890 (+ 1815us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":69,"threads_started":1}
W20260809 02:19:51.613037 21366 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:51.608268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:40519 (local address 127.11.93.190:45689)
0809 02:19:51.608327 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:51.608329 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:51.608373 (+ 44us) server_negotiation.cc:407] Connection header received
0809 02:19:51.608471 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:51.608471 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:51.608486 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:51.608535 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:51.608937 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:51.609458 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:51.610188 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:51.610403 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:51.610492 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:51.612968 (+ 2476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.131:40519: BlockingRecv error: recv got EOF from 127.11.93.131:40519 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 09 02:19:52 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:52 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:52.347419 21369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:52.343036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.129:37783)
0809 02:19:52.343167 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:52.343178 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:52.343233 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:52.343462 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:52.343463 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:52.343634 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:52.343681 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:52.343683 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:52.344315 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:52.344316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:52.344822 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:52.344823 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:52.345144 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:52.345144 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:52.345182 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:52.345634 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:52.345638 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:52.347360 (+ 1722us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":62,"threads_started":1}
W20260809 02:19:52.347568 21370 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:52.343126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:37783 (local address 127.11.93.190:45689)
0809 02:19:52.343255 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:52.343257 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:52.343266 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:19:52.343345 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:52.343346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:52.343359 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:52.343440 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:52.343751 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:52.344247 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:52.344895 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:52.345080 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:52.345130 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:52.347470 (+ 2340us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.129:37783: BlockingRecv error: recv got EOF from 127.11.93.129:37783 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":73,"threads_started":1}
Aug 09 02:19:52 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:52 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:52.492250 21371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:52.487782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.130:47187)
0809 02:19:52.487926 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:52.487937 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:52.488010 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:52.488170 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:52.488171 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:52.488354 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:52.488405 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:52.488407 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:52.489023 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:52.489024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:52.489533 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:52.489534 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:52.489847 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:52.489848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:52.489887 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:52.490311 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:52.490315 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:52.492191 (+ 1876us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":87,"threads_started":1}
W20260809 02:19:52.492436 21370 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:52.487972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:47187 (local address 127.11.93.190:45689)
0809 02:19:52.488026 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:52.488028 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:52.488039 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:19:52.488068 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:52.488069 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:52.488082 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:52.488148 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:52.488476 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:52.488955 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:52.489602 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:52.489777 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:52.489825 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:52.492360 (+ 2535us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.130:47187: BlockingRecv error: recv got EOF from 127.11.93.130:47187 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 09 02:19:52 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:52 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:52.618153 21372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:52.613667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.131:40665)
0809 02:19:52.613845 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:52.613857 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:52.613940 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:52.614084 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:52.614085 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:52.614249 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:52.614307 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:52.614309 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:52.614941 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:52.614941 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:52.615472 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:52.615474 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:52.615809 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:52.615810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:52.615850 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:52.616294 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:52.616299 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:52.618092 (+ 1793us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":136,"threads_started":1}
W20260809 02:19:52.618256 21370 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:52.613799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:40665 (local address 127.11.93.190:45689)
0809 02:19:52.613852 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:52.613854 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:52.613948 (+ 94us) server_negotiation.cc:407] Connection header received
0809 02:19:52.613982 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:52.613983 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:52.613997 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:52.614062 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:52.614371 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:52.614867 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:52.615539 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:52.615729 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:52.615795 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:52.618187 (+ 2392us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.131:40665: BlockingRecv error: recv got EOF from 127.11.93.131:40665 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 09 02:19:53 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:53 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:53.352700 21373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:53.347944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.129:59047)
0809 02:19:53.348123 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:53.348137 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:53.348204 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:53.348404 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:53.348405 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:53.348614 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:53.348673 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:53.348675 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:53.349352 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:53.349353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:53.349881 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:53.349883 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:53.350215 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:53.350216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:53.350254 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:53.350705 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:53.350710 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:53.352640 (+ 1930us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":100,"threads_started":1}
W20260809 02:19:53.352813 21375 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:53.348104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:59047 (local address 127.11.93.190:45689)
0809 02:19:53.348227 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:53.348230 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:53.348241 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:19:53.348275 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:53.348275 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:53.348287 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:53.348363 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:53.348752 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:53.349273 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:53.349954 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:53.350149 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:53.350202 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:53.352736 (+ 2534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.129:59047: BlockingRecv error: recv got EOF from 127.11.93.129:59047 (error 108)
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":57,"threads_started":1}
Aug 09 02:19:53 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:53 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:53.497746 21376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:53.492659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.130:35233)
0809 02:19:53.492796 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:53.492807 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:53.492867 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:53.493024 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:53.493025 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:53.493195 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:53.493244 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:53.493246 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:53.493884 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:53.493885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:53.494470 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:53.494473 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:53.494917 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:53.494918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:53.495005 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:53.495554 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:53.495560 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:53.497686 (+ 2126us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":73,"threads_started":1}
W20260809 02:19:53.497939 21375 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:53.492729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:35233 (local address 127.11.93.190:45689)
0809 02:19:53.492812 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:53.492814 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:53.492865 (+ 51us) server_negotiation.cc:407] Connection header received
0809 02:19:53.492957 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:53.492957 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:53.492969 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:53.493017 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:53.493308 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:53.493815 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:53.494587 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:53.494834 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:53.494915 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:53.497859 (+ 2944us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.130:35233: BlockingRecv error: recv got EOF from 127.11.93.130:35233 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 09 02:19:53 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:53 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:53.623590 21377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:53.618696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.131:50769)
0809 02:19:53.618886 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:53.618897 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:53.619019 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:53.619191 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:53.619192 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:53.619409 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:53.619458 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:53.619460 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:53.620189 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:53.620190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:53.620793 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:53.620796 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:53.621162 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:53.621163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:53.621221 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:53.621658 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:53.621662 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:53.623489 (+ 1827us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":117,"threads_started":1}
W20260809 02:19:53.623636 21375 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:53.618891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:50769 (local address 127.11.93.190:45689)
0809 02:19:53.619013 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:53.619015 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:53.619025 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:19:53.619090 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:53.619091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:53.619108 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:53.619180 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:53.619544 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:53.620101 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:53.620880 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:53.621077 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:53.621161 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:53.623571 (+ 2410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.131:50769: BlockingRecv error: recv got EOF from 127.11.93.131:50769 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 09 02:19:54 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:54 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:54.361078 21378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:54.353334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.129:47377)
0809 02:19:54.353465 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:54.353477 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:54.353539 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:54.353707 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:54.353709 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:54.353878 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:54.353930 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:54.353931 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:54.354674 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:54.354675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:54.355218 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:54.355220 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:54.355719 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:54.355720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:54.355814 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:54.359153 (+ 3339us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:54.359158 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:54.361019 (+ 1861us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":89,"threads_started":1}
W20260809 02:19:54.361225 21379 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:54.353443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:47377 (local address 127.11.93.190:45689)
0809 02:19:54.353566 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:54.353568 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:54.353577 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:19:54.353608 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:54.353609 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:54.353619 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:54.353693 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:54.353995 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:54.354582 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:54.355316 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:54.355632 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:54.355705 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:54.361128 (+ 5423us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.129:47377: BlockingRecv error: recv got EOF from 127.11.93.129:47377 (error 108)
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":72,"threads_started":1}
Aug 09 02:19:54 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:54 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:54.502770 21380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:54.498249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.130:46819)
0809 02:19:54.498412 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:54.498423 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:54.498491 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:54.498617 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:54.498618 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:54.498796 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:54.498854 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:54.498856 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:54.499566 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:54.499567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:54.500099 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:54.500101 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:54.500411 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:54.500412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:54.500451 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:54.500899 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:54.500904 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:54.502709 (+ 1805us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":69,"threads_started":1}
W20260809 02:19:54.502898 21379 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:54.498337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:46819 (local address 127.11.93.190:45689)
0809 02:19:54.498415 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:54.498417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:54.498494 (+ 77us) server_negotiation.cc:407] Connection header received
0809 02:19:54.498533 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:54.498534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:54.498545 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:54.498596 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:54.498987 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:54.499496 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:54.500168 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:54.500349 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:54.500409 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:54.502801 (+ 2392us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.130:46819: BlockingRecv error: recv got EOF from 127.11.93.130:46819 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 09 02:19:54 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:54 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
W20260809 02:19:54.629232 21379 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:54.624305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:37419 (local address 127.11.93.190:45689)
0809 02:19:54.624383 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:54.624385 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:54.624476 (+ 91us) server_negotiation.cc:407] Connection header received
0809 02:19:54.624596 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:54.624597 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:54.624611 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:54.624687 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:54.625075 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:54.625598 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:54.626310 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:54.626564 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:54.626644 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:54.629178 (+ 2534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.131:37419: BlockingRecv error: recv got EOF from 127.11.93.131:37419 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:19:54.629235 21381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:54.624191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.131:37419)
0809 02:19:54.624392 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:54.624404 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:54.624497 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:54.624699 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:54.624700 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:54.624922 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:54.624977 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:54.624979 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:54.625697 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:54.625698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:54.626227 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:54.626228 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:54.626643 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:54.626644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:54.626713 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:54.627307 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:54.627312 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:54.629095 (+ 1783us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":103,"threads_started":1}
Aug 09 02:19:55 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:55 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:55.366406 21382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:55.361626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.129:43753)
0809 02:19:55.361775 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:55.361790 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:55.361846 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:55.362052 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:55.362054 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:55.362224 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:55.362302 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:55.362304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:55.363089 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:55.363090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:55.363616 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:55.363618 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:55.363979 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:55.363980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:55.364025 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:55.364481 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:55.364486 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:55.366344 (+ 1858us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":87,"threads_started":1}
W20260809 02:19:55.366556 21383 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:55.361727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:43753 (local address 127.11.93.190:45689)
0809 02:19:55.361861 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:55.361863 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:55.361873 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:19:55.361907 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:55.361908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:55.361919 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:55.361993 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:55.362408 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:55.362940 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:55.363687 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:55.363907 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:55.363961 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:55.366453 (+ 2492us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.129:43753: BlockingRecv error: recv got EOF from 127.11.93.129:43753 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":80,"threads_started":1}
Aug 09 02:19:55 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:55 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:55.508149 21384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:55.503290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.130:41171)
0809 02:19:55.503447 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:55.503460 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:55.503536 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:55.503662 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:55.503663 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:55.503854 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:55.503902 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:55.503904 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:55.504548 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:55.504549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:55.505079 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:55.505080 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:55.505427 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:55.505428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:55.505467 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:55.505969 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:55.505974 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:55.508049 (+ 2075us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":76,"threads_started":1}
W20260809 02:19:55.508203 21383 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:55.503428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:41171 (local address 127.11.93.190:45689)
0809 02:19:55.503493 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:55.503494 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:55.503520 (+ 26us) server_negotiation.cc:407] Connection header received
0809 02:19:55.503593 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:55.503593 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:55.503604 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:55.503643 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:55.503980 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:55.504476 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:55.505166 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:55.505358 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:55.505419 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:55.508135 (+ 2716us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.130:41171: BlockingRecv error: recv got EOF from 127.11.93.130:41171 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 09 02:19:55 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:55 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:55.634805 21385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:55.629888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.131:54981)
0809 02:19:55.630030 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:55.630041 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:55.630109 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:55.630272 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:55.630272 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:55.630448 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:55.630500 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:55.630501 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:55.631166 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:55.631167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:55.631715 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:55.631717 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:55.632047 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:55.632048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:55.632089 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:55.632655 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:55.632666 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:55.634739 (+ 2073us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":85,"threads_started":1}
W20260809 02:19:55.635011 21383 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:55.629960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:54981 (local address 127.11.93.190:45689)
0809 02:19:55.630035 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:55.630037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:55.630110 (+ 73us) server_negotiation.cc:407] Connection header received
0809 02:19:55.630152 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:55.630153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:55.630167 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:55.630218 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:55.630560 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:55.631087 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:55.631801 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:55.631983 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:55.632037 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:55.634897 (+ 2860us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.131:54981: BlockingRecv error: recv got EOF from 127.11.93.131:54981 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 09 02:19:56 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:56 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:56.371805 21386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:56.366977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.129:39481)
0809 02:19:56.367170 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:56.367180 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:56.367238 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:56.367443 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:56.367444 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:56.367638 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:56.367718 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:56.367720 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:56.368388 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:56.368389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:56.368979 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:56.368981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:56.369333 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:56.369334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:56.369395 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:56.369875 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:56.369879 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:56.371745 (+ 1866us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":88,"threads_started":1}
W20260809 02:19:56.371940 21387 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:56.367050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:39481 (local address 127.11.93.190:45689)
0809 02:19:56.367196 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:56.367198 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:56.367230 (+ 32us) server_negotiation.cc:407] Connection header received
0809 02:19:56.367318 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:56.367318 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:56.367329 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:56.367385 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:56.367801 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:56.368304 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:56.369072 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:56.369268 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:56.369321 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:56.371844 (+ 2523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.129:39481: BlockingRecv error: recv got EOF from 127.11.93.129:39481 (error 108)
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":98,"threads_started":1}
Aug 09 02:19:56 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:56 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:56.513578 21388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:56.508849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.130:41499)
0809 02:19:56.509079 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:56.509097 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:56.509157 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:56.509303 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:56.509304 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:56.509494 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:56.509543 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:56.509545 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:56.510164 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:56.510165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:56.510686 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:56.510688 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:56.511072 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:56.511073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:56.511116 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:56.511642 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:56.511647 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:56.513519 (+ 1872us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":165,"threads_started":1}
W20260809 02:19:56.513788 21387 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:56.508965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:41499 (local address 127.11.93.190:45689)
0809 02:19:56.509032 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:56.509034 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:56.509154 (+ 120us) server_negotiation.cc:407] Connection header received
0809 02:19:56.509204 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:56.509205 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:56.509217 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:56.509292 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:56.509609 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:56.510097 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:56.510780 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:56.511004 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:56.511068 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:56.513718 (+ 2650us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.130:41499: BlockingRecv error: recv got EOF from 127.11.93.130:41499 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 09 02:19:56 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:56 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:56.640110 21389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:56.635306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.131:44591)
0809 02:19:56.635437 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:56.635452 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:56.635525 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:56.635680 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:56.635681 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:56.635892 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:56.635942 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:56.635944 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:56.636647 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:56.636648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:56.637194 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:56.637196 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:56.637640 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:56.637641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:56.637705 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:56.638200 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:56.638204 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:56.640007 (+ 1803us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":81,"threads_started":1}
W20260809 02:19:56.640151 21387 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:56.635413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:44591 (local address 127.11.93.190:45689)
0809 02:19:56.635475 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:56.635477 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:56.635506 (+ 29us) server_negotiation.cc:407] Connection header received
0809 02:19:56.635582 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:56.635589 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:56.635609 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:56.635673 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:56.636027 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:56.636559 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:56.637312 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:56.637561 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:56.637640 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:56.640088 (+ 2448us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.131:44591: BlockingRecv error: recv got EOF from 127.11.93.131:44591 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 09 02:19:57 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:57 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:57.377120 21390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:57.372328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.129:48349)
0809 02:19:57.372489 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:57.372500 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:57.372558 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:57.372697 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:57.372698 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:57.372871 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:57.372921 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:57.372923 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:57.373575 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:57.373576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:57.374115 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:57.374116 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:57.374492 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:57.374493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:57.374548 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:57.375011 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:57.375015 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:57.377021 (+ 2006us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":88,"threads_started":1}
W20260809 02:19:57.377187 21391 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:57.372442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:48349 (local address 127.11.93.190:45689)
0809 02:19:57.372573 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:57.372575 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:57.372586 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:19:57.372609 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:57.372609 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:57.372620 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:57.372679 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:57.372989 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:57.373500 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:57.374188 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:57.374384 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:57.374437 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:57.377101 (+ 2664us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.129:48349: BlockingRecv error: recv got EOF from 127.11.93.129:48349 (error 108)
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":75,"threads_started":1}
Aug 09 02:19:57 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:57 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:57.519094 21392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:57.514164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.130:38849)
0809 02:19:57.514299 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:57.514318 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:57.514380 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:57.514552 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:57.514553 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:57.514726 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:57.514778 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:57.514780 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:57.515506 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:57.515507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:57.516019 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:57.516021 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:57.516361 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:57.516362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:57.516408 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:57.517008 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:57.517013 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:57.519030 (+ 2017us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":80,"threads_started":1}
W20260809 02:19:57.519186 21391 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:57.514262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:38849 (local address 127.11.93.190:45689)
0809 02:19:57.514319 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:57.514322 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:57.514370 (+ 48us) server_negotiation.cc:407] Connection header received
0809 02:19:57.514461 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:57.514462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:57.514473 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:57.514528 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:57.514841 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:57.515426 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:57.516088 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:57.516296 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:57.516347 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:57.519119 (+ 2772us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.130:38849: BlockingRecv error: recv got EOF from 127.11.93.130:38849 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 09 02:19:57 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:57 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:57.645148 21394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:57.640602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.131:42649)
0809 02:19:57.640738 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:57.640748 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:57.640806 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:57.640950 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:57.640951 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:57.641115 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:57.641169 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:57.641171 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:57.641781 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:57.641782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:57.642325 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:57.642327 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:57.642641 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:57.642642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:57.642680 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:57.643217 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:57.643221 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:57.645087 (+ 1866us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":73,"threads_started":1}
W20260809 02:19:57.645251 21391 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:57.640671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:42649 (local address 127.11.93.190:45689)
0809 02:19:57.640734 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:57.640738 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:57.640811 (+ 73us) server_negotiation.cc:407] Connection header received
0809 02:19:57.640852 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:57.640852 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:57.640868 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:57.640928 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:57.641230 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:57.641710 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:57.642405 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:57.642580 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:57.642628 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:57.645178 (+ 2550us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.131:42649: BlockingRecv error: recv got EOF from 127.11.93.131:42649 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 09 02:19:58 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:58 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:58.382305 21395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:58.377660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.129:39077)
0809 02:19:58.377826 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:58.377841 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:58.377920 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:58.378045 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:58.378046 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:58.378213 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:58.378262 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:58.378263 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:58.378921 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:58.378921 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:58.379450 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:58.379452 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:58.379773 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:58.379774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:58.379818 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:58.380306 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:58.380310 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:58.382221 (+ 1911us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":75,"threads_started":1}
W20260809 02:19:58.382503 21397 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:58.377795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:39077 (local address 127.11.93.190:45689)
0809 02:19:58.377930 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:58.377932 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:58.377941 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:19:58.377964 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:58.377964 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:58.377974 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:58.378032 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:58.378330 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:58.378829 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:58.379519 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:58.379709 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:58.379762 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:58.382336 (+ 2574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.129:39077: BlockingRecv error: recv got EOF from 127.11.93.129:39077 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":73,"threads_started":1}
Aug 09 02:19:58 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:58 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:58.524309 21398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:58.519610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.130:37097)
0809 02:19:58.519774 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:58.519791 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:58.519848 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:58.520006 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:58.520007 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:58.520177 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:58.520228 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:58.520229 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:58.521021 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:58.521022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:58.521563 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:58.521565 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:58.521875 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:58.521875 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:58.521915 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:58.522439 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:58.522444 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:58.524244 (+ 1800us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":111,"threads_started":1}
W20260809 02:19:58.524495 21397 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:58.519674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:37097 (local address 127.11.93.190:45689)
0809 02:19:58.519741 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:58.519743 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:58.519849 (+ 106us) server_negotiation.cc:407] Connection header received
0809 02:19:58.519921 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:58.519922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:58.519933 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:58.519978 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:58.520316 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:58.520953 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:58.521635 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:58.521813 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:58.521861 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:58.524393 (+ 2532us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.130:37097: BlockingRecv error: recv got EOF from 127.11.93.130:37097 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 09 02:19:58 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:58 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:58.650916 21399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:58.645688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.131:51529)
0809 02:19:58.645857 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:58.645870 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:58.645950 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:58.646107 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:58.646107 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:58.646345 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:58.646404 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:58.646405 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:58.647129 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:58.647130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:58.647757 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:58.647760 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:58.648097 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:58.648098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:58.648143 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:58.648915 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:58.648921 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:58.650840 (+ 1919us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":79,"threads_started":1}
W20260809 02:19:58.651054 21397 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:58.645811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:51529 (local address 127.11.93.190:45689)
0809 02:19:58.645887 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:58.645889 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:58.645929 (+ 40us) server_negotiation.cc:407] Connection header received
0809 02:19:58.646011 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:58.646012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:58.646026 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:58.646076 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:58.646486 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:58.647052 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:58.647837 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:58.648027 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:58.648077 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:58.650946 (+ 2869us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.131:51529: BlockingRecv error: recv got EOF from 127.11.93.131:51529 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 09 02:19:59 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:59 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:59.391703 21400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:59.382827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.129:49253)
0809 02:19:59.383035 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:59.383056 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:59.383127 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:59.383268 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:59.383270 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:59.383448 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:59.383502 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:59.383504 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:59.384164 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:59.384166 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:59.384781 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:59.384784 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:59.385144 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:59.385145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:59.385202 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:59.389428 (+ 4226us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:59.389434 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:59.391606 (+ 2172us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":97,"threads_started":1}
W20260809 02:19:59.391770 21401 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:59.382876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:49253 (local address 127.11.93.190:45689)
0809 02:19:59.383045 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:59.383047 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:59.383127 (+ 80us) server_negotiation.cc:407] Connection header received
0809 02:19:59.383190 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:59.383190 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:59.383202 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:59.383261 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:59.383566 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:59.384068 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:59.384873 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:59.385072 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:59.385125 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:59.391698 (+ 6573us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.129:49253: BlockingRecv error: recv got EOF from 127.11.93.129:49253 (error 108)
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":90,"threads_started":1}
Aug 09 02:19:59 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:59 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:59.529521 21402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:59.524871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.130:42395)
0809 02:19:59.525045 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:59.525055 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:59.525117 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:59.525263 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:59.525264 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:59.525450 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:59.525505 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:59.525507 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:59.526128 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:59.526129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:59.526662 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:59.526664 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:59.527037 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:59.527038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:59.527089 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:59.527537 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:59.527542 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:59.529455 (+ 1913us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":113,"threads_started":1}
W20260809 02:19:59.529644 21401 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:59.524940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:42395 (local address 127.11.93.190:45689)
0809 02:19:59.525015 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:59.525018 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:59.525119 (+ 101us) server_negotiation.cc:407] Connection header received
0809 02:19:59.525162 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:59.525162 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:59.525175 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:59.525229 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:59.525572 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:59.526054 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:59.526737 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:59.526919 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:59.526993 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:59.529560 (+ 2567us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.130:42395: BlockingRecv error: recv got EOF from 127.11.93.130:42395 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 09 02:19:59 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:19:59 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:19:59.656525 21403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:19:59.651591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.131:34705)
0809 02:19:59.651784 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 02:19:59.651803 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 02:19:59.651868 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:19:59.651998 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:19:59.651999 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:19:59.652193 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:19:59.652249 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:59.652251 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:59.653032 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:59.653033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:59.653631 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:19:59.653634 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:19:59.654043 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:19:59.654044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:19:59.654096 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:59.654562 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:19:59.654567 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:19:59.656466 (+ 1899us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":141,"threads_started":1}
W20260809 02:19:59.656657 21401 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:19:59.651677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:34705 (local address 127.11.93.190:45689)
0809 02:19:59.651753 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 02:19:59.651755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:19:59.651866 (+ 111us) server_negotiation.cc:407] Connection header received
0809 02:19:59.651925 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:19:59.651926 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:19:59.651938 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:19:59.651992 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:19:59.652308 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:59.652950 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:59.653708 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:19:59.653932 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:19:59.653986 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:19:59.656555 (+ 2569us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.131:34705: BlockingRecv error: recv got EOF from 127.11.93.131:34705 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 09 02:20:00 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:20:00 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:20:00.397224 21404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:00.392193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.129:44239)
0809 02:20:00.392398 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:00.392410 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:00.392480 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:00.392646 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:00.392647 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:00.392814 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:00.392864 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:00.392865 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:00.393488 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:00.393489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:00.394008 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:00.394009 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:00.394348 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:00.394350 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:00.394391 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:00.395072 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:00.395077 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:00.397162 (+ 2085us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":132,"threads_started":1}
W20260809 02:20:00.397382 21405 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:20:00.392269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:44239 (local address 127.11.93.190:45689)
0809 02:20:00.392435 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:00.392438 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:00.392463 (+ 25us) server_negotiation.cc:407] Connection header received
0809 02:20:00.392559 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:00.392560 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:00.392572 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:00.392643 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:00.392924 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:00.393420 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:00.394074 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:00.394281 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:00.394339 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:00.397285 (+ 2946us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.129:44239: BlockingRecv error: recv got EOF from 127.11.93.129:44239 (error 108)
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":71,"threads_started":1}
Aug 09 02:20:00 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:20:00 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:20:00.534809 21406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:00.530068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.130:44165)
0809 02:20:00.530235 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:00.530264 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:00.530351 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:00.530507 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:00.530508 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:00.530683 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:00.530735 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:00.530736 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:00.531402 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:00.531403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:00.531935 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:00.531937 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:00.532261 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:00.532262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:00.532302 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:00.532781 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:00.532786 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:00.534749 (+ 1963us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":70,"threads_started":1}
W20260809 02:20:00.534948 21405 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:20:00.530165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:44165 (local address 127.11.93.190:45689)
0809 02:20:00.530245 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:00.530247 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:00.530332 (+ 85us) server_negotiation.cc:407] Connection header received
0809 02:20:00.530423 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:00.530424 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:00.530436 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:00.530479 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:00.530819 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:00.531336 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:00.532007 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:00.532194 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:00.532247 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:00.534862 (+ 2615us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.130:44165: BlockingRecv error: recv got EOF from 127.11.93.130:44165 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 09 02:20:00 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:20:00 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:20:00.661881 21407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:00.657017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.131:50379)
0809 02:20:00.657182 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:00.657195 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:00.657259 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:00.657458 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:00.657459 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:00.657645 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:00.657694 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:00.657696 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:00.658392 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:00.658394 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:00.658920 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:00.658922 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:00.659361 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:00.659362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:00.659428 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:00.659858 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:00.659863 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:00.661802 (+ 1939us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":104,"threads_started":1}
W20260809 02:20:00.661955 21405 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:20:00.657156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:50379 (local address 127.11.93.190:45689)
0809 02:20:00.657223 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:00.657225 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:00.657238 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:20:00.657342 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:00.657343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:00.657361 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:00.657446 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:00.657809 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:00.658305 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:00.659069 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:00.659273 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:00.659348 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:00.661905 (+ 2557us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.131:50379: BlockingRecv error: recv got EOF from 127.11.93.131:50379 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 09 02:20:01 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:20:01 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:20:01.402777 21408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:01.397705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.129:52859)
0809 02:20:01.397905 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:01.397915 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:01.397984 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:01.398117 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:01.398118 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:01.398359 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:01.398411 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:01.398413 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:01.399283 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:01.399284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:01.399813 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:01.399814 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:01.400224 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:01.400225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:01.400290 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:01.400795 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:01.400801 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:01.402707 (+ 1906us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":127,"threads_started":1}
W20260809 02:20:01.402887 21410 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:20:01.397788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:52859 (local address 127.11.93.190:45689)
0809 02:20:01.397915 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:01.397917 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:01.397986 (+ 69us) server_negotiation.cc:407] Connection header received
0809 02:20:01.398028 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:01.398029 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:01.398040 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:01.398099 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:01.398498 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:01.399199 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:01.399901 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:01.400135 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:01.400222 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:01.402807 (+ 2585us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.129:52859: BlockingRecv error: recv got EOF from 127.11.93.129:52859 (error 108)
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":54,"threads_started":1}
Aug 09 02:20:01 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:20:01 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:20:01.540532 21411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:01.535384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.130:54485)
0809 02:20:01.535585 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:01.535596 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:01.535690 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:01.535855 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:01.535856 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:01.536059 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:01.536107 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:01.536109 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:01.536785 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:01.536786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:01.537331 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:01.537333 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:01.537714 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:01.537715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:01.537771 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:01.538251 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:01.538256 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:01.540419 (+ 2163us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":104,"threads_started":1}
W20260809 02:20:01.540570 21410 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:20:01.535486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:54485 (local address 127.11.93.190:45689)
0809 02:20:01.535563 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:01.535565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:01.535667 (+ 102us) server_negotiation.cc:407] Connection header received
0809 02:20:01.535762 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:01.535763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:01.535782 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:01.535846 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:01.536191 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:01.536696 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:01.537438 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:01.537637 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:01.537715 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:01.540502 (+ 2787us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.130:54485: BlockingRecv error: recv got EOF from 127.11.93.130:54485 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 09 02:20:01 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:20:01 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:20:01.667385 21412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:01.662427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.131:51753)
0809 02:20:01.662628 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:01.662640 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:01.662730 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:01.662891 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:01.662892 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:01.663110 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:01.663155 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:01.663157 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:01.663873 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:01.663874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:01.664414 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:01.664416 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:01.664790 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:01.664791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:01.664855 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:01.665336 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:01.665341 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:01.667274 (+ 1933us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":119,"threads_started":1}
W20260809 02:20:01.667428 21410 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:20:01.662522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:51753 (local address 127.11.93.190:45689)
0809 02:20:01.662611 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:01.662613 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:01.662712 (+ 99us) server_negotiation.cc:407] Connection header received
0809 02:20:01.662816 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:01.662817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:01.662832 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:01.662886 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:01.663243 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:01.663775 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:01.664504 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:01.664705 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:01.664788 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:01.667362 (+ 2574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.131:51753: BlockingRecv error: recv got EOF from 127.11.93.131:51753 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 02:20:02 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:20:02 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:20:02.407981 21413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:02.403276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.129:58237)
0809 02:20:02.403421 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:02.403432 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:02.403491 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:02.403633 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:02.403634 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:02.403814 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:02.403862 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:02.403863 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:02.404513 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:02.404514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:02.405050 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:02.405051 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:02.405402 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:02.405403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:02.405457 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:02.405957 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:02.405962 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:02.407916 (+ 1954us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":89,"threads_started":1}
W20260809 02:20:02.408130 21414 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:20:02.403325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:58237 (local address 127.11.93.190:45689)
0809 02:20:02.403480 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:02.403482 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:02.403492 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:20:02.403542 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:02.403543 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:02.403553 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:02.403613 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:02.403928 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:02.404436 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:02.405121 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:02.405310 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:02.405362 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:02.408014 (+ 2652us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.129:58237: BlockingRecv error: recv got EOF from 127.11.93.129:58237 (error 108)
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":103,"threads_started":1}
Aug 09 02:20:02 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:20:02 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:20:02.546269 21415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:02.541115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.130:37943)
0809 02:20:02.541273 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:02.541285 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:02.541373 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:02.541567 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:02.541569 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:02.541770 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:02.541820 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:02.541822 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:02.542528 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:02.542529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:02.543221 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:02.543225 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:02.543684 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:02.543685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:02.543749 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:02.544296 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:02.544300 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:02.546172 (+ 1872us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":99,"threads_started":1}
W20260809 02:20:02.546334 21414 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:20:02.541308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:37943 (local address 127.11.93.190:45689)
0809 02:20:02.541420 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:02.541422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:02.541431 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:20:02.541461 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:02.541462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:02.541474 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:02.541548 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:02.541909 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:02.542428 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:02.543304 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:02.543592 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:02.543681 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:02.546269 (+ 2588us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.130:37943: BlockingRecv error: recv got EOF from 127.11.93.130:37943 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 09 02:20:02 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:20:02 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:20:02.672688 21416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:02.667874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.131:42239)
0809 02:20:02.668085 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:02.668096 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:02.668188 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:02.668359 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:02.668361 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:02.668554 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:02.668599 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:02.668601 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:02.669325 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:02.669326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:02.669865 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:02.669867 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:02.670234 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:02.670235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:02.670344 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:02.670794 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:02.670799 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:02.672586 (+ 1787us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":130,"threads_started":1}
W20260809 02:20:02.672739 21414 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:20:02.667962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:42239 (local address 127.11.93.190:45689)
0809 02:20:02.668048 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:02.668051 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:02.668167 (+ 116us) server_negotiation.cc:407] Connection header received
0809 02:20:02.668256 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:02.668257 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:02.668272 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:02.668334 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:02.668682 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:02.669186 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:02.669957 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:02.670157 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:02.670234 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:02.672672 (+ 2438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.131:42239: BlockingRecv error: recv got EOF from 127.11.93.131:42239 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 09 02:20:03 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:20:03 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:20:03.413412 21417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:03.408558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.129:55203)
0809 02:20:03.408716 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:03.408734 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:03.408785 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:03.408952 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:03.408953 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:03.409125 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:03.409183 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:03.409184 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:03.409874 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:03.409875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:03.410410 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:03.410411 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:03.410769 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:03.410770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:03.410810 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:03.411349 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:03.411354 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:03.413348 (+ 1994us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":90,"threads_started":1}
W20260809 02:20:03.413517 21418 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:20:03.408680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:55203 (local address 127.11.93.190:45689)
0809 02:20:03.408816 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:03.408818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:03.408826 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:20:03.408849 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:03.408850 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:03.408860 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:03.408929 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:03.409266 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:03.409802 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:03.410498 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:03.410700 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:03.410758 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:03.413442 (+ 2684us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.129:55203: BlockingRecv error: recv got EOF from 127.11.93.129:55203 (error 108)
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":78,"threads_started":1}
Aug 09 02:20:03 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:20:03 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:20:03.551712 21419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:03.546831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.130:56467)
0809 02:20:03.547020 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:03.547033 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:03.547095 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:03.547216 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:03.547216 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:03.547413 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:03.547463 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:03.547464 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:03.548111 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:03.548112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:03.548636 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:03.548638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:03.548998 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:03.548999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:03.549040 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:03.549524 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:03.549529 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:03.551608 (+ 2079us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":89,"threads_started":1}
W20260809 02:20:03.551796 21418 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:20:03.546955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:56467 (local address 127.11.93.190:45689)
0809 02:20:03.547022 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:03.547024 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:03.547082 (+ 58us) server_negotiation.cc:407] Connection header received
0809 02:20:03.547154 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:03.547155 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:03.547165 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:03.547204 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:03.547531 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:03.548034 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:03.548730 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:03.548926 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:03.548983 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:03.551727 (+ 2744us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.130:56467: BlockingRecv error: recv got EOF from 127.11.93.130:56467 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 09 02:20:03 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:20:03 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:20:03.678238 21420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:03.673279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.131:49395)
0809 02:20:03.673505 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:03.673518 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:03.673582 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:03.673798 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:03.673799 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:03.674059 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:03.674122 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:03.674125 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:03.674787 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:03.674787 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:03.675355 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:03.675357 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:03.675658 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:03.675659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:03.675698 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:03.676210 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:03.676216 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:03.678082 (+ 1866us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":141,"threads_started":1}
W20260809 02:20:03.678289 21418 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:20:03.673401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:49395 (local address 127.11.93.190:45689)
0809 02:20:03.673467 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:03.673470 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:03.673591 (+ 121us) server_negotiation.cc:407] Connection header received
0809 02:20:03.673653 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:03.673654 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:03.673681 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:03.673750 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:03.674213 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:03.674708 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:03.675424 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:03.675596 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:03.675646 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:03.678209 (+ 2563us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.131:49395: BlockingRecv error: recv got EOF from 127.11.93.131:49395 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 09 02:20:04 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:20:04 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:20:04.423882 21421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:04.413969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.129:44209)
0809 02:20:04.414116 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:04.414127 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:04.414176 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:04.414357 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:04.414358 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:04.414537 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:04.414584 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:04.414585 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:04.415336 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:04.415337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:04.415880 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:04.415881 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:04.416240 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:04.416241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:04.416278 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:04.421815 (+ 5537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:04.421820 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:04.423812 (+ 1992us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":83,"threads_started":1}
W20260809 02:20:04.424062 21422 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:20:04.414083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:44209 (local address 127.11.93.190:45689)
0809 02:20:04.414227 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:04.414229 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:04.414237 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:20:04.414261 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:04.414261 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:04.414271 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:04.414338 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:04.414659 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:04.415254 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:04.415957 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:04.416171 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:04.416230 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:04.423962 (+ 7732us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.129:44209: BlockingRecv error: recv got EOF from 127.11.93.129:44209 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":80,"threads_started":1}
Aug 09 02:20:04 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:20:04 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:20:04.557616 21423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:04.552411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.130:35069)
0809 02:20:04.552587 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:04.552597 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:04.552664 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:04.552803 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:04.552804 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:04.553000 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:04.553047 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:04.553050 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:04.553756 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:04.553757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:04.554294 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:04.554295 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:04.554798 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:04.554799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:04.554871 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:04.555446 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:04.555450 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:04.557540 (+ 2090us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":100,"threads_started":1}
W20260809 02:20:04.557749 21422 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:20:04.552483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:35069 (local address 127.11.93.190:45689)
0809 02:20:04.552558 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:04.552560 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:04.552666 (+ 106us) server_negotiation.cc:407] Connection header received
0809 02:20:04.552714 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:04.552714 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:04.552726 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:04.552788 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:04.553111 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:04.553647 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:04.554367 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:04.554582 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:04.554642 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:04.557638 (+ 2996us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.130:35069: BlockingRecv error: recv got EOF from 127.11.93.130:35069 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 09 02:20:04 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:20:04 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.131@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:20:04.683815 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:04.678818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.131:47861)
0809 02:20:04.678966 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:04.679025 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:04.679095 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:04.679239 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:04.679240 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:04.679438 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:04.679488 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:04.679490 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:04.680133 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:04.680134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:04.680713 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:04.680715 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:04.681203 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:04.681205 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:04.681282 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:04.681796 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:04.681802 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:04.683715 (+ 1913us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":89,"threads_started":1}
W20260809 02:20:04.683848 21422 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:20:04.678929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:47861 (local address 127.11.93.190:45689)
0809 02:20:04.679012 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:04.679014 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:04.679100 (+ 86us) server_negotiation.cc:407] Connection header received
0809 02:20:04.679160 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:04.679161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:04.679173 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:04.679216 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:04.679554 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:04.680057 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:04.680824 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:04.681124 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:04.681189 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:04.683787 (+ 2598us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.131:47861: BlockingRecv error: recv got EOF from 127.11.93.131:47861 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 02:20:05 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:20:05 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.129@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:20:05.429440 21425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:05.424447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.129:41237)
0809 02:20:05.424615 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:05.424631 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:05.424694 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:05.424815 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:05.424816 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:05.424993 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:05.425052 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:05.425053 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:05.425726 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:05.425727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:05.426272 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:05.426273 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:05.426686 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:05.426687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:05.426733 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:05.427381 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:05.427386 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:05.429375 (+ 1989us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":79,"threads_started":1}
W20260809 02:20:05.429605 21426 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:20:05.424504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:41237 (local address 127.11.93.190:45689)
0809 02:20:05.424676 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:05.424678 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:05.424686 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:20:05.424740 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:05.424741 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:05.424752 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:05.424808 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:05.425113 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:05.425636 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:05.426410 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:05.426610 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:05.426666 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:05.429517 (+ 2851us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.129:41237: BlockingRecv error: recv got EOF from 127.11.93.129:41237 (error 108)
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":111,"threads_started":1}
Aug 09 02:20:05 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:20:05 dist-test-slave-w206 krb5kdc[20297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.93.130@KRBTEST.COM for oryx/127.11.93.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:20:05.562666 21427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:05.558176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:45689 (local address 127.11.93.130:34795)
0809 02:20:05.558345 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:05.558358 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:05.558432 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:05.558550 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:05.558551 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:05.558715 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:05.558768 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:05.558769 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:05.559458 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:05.559459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:05.559989 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:05.559991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:05.560311 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:05.560312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:05.560351 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:05.560793 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:05.560798 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:05.562604 (+ 1806us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.93.190:45689: Server oryx/127.11.93.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":67,"threads_started":1}
W20260809 02:20:05.562781 21426 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:20:05.558245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:34795 (local address 127.11.93.190:45689)
0809 02:20:05.558316 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:05.558318 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:05.558432 (+ 114us) server_negotiation.cc:407] Connection header received
0809 02:20:05.558483 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:05.558485 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:05.558496 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:05.558544 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:05.558823 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:05.559372 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:05.560061 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:05.560245 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:05.560295 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:05.562710 (+ 2415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.93.130:34795: BlockingRecv error: recv got EOF from 127.11.93.130:34795 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:20:05.608825 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 20915
I20260809 02:20:05.615113 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 21078
I20260809 02:20:05.621203 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 21222
I20260809 02:20:05.626590 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 20843
2026-08-09T02:20:05Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17629 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-09T02:20:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:20:05Z Disabled control of system clock
I20260809 02:20:05.658324 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:41185
--webserver_interface=127.11.93.190
--webserver_port=0
--builtin_ntp_servers=127.11.93.148:44699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:41185
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 02:20:05.746829 21431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:05.747092 21431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:05.747116 21431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:05.748343 21431 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:20:05.748387 21431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:05.748400 21431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:05.748412 21431 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:20:05.748425 21431 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:20:05.749778 21431 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:44699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:41185
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:41185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:20:05.750010 21431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:05.750274 21431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:05.755724 21437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:05.755846 21431 server_base.cc:1034] running on GCE node
W20260809 02:20:05.755767 21438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:05.755800 21440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:05.756194 21431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:05.756500 21431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:05.757669 21431 hybrid_clock.cc:648] HybridClock initialized: now 1786242005757628 us; error 51 us; skew 500 ppm
I20260809 02:20:05.759056 21431 webserver.cc:460] Webserver started at http://127.11.93.190:40165/ using document root <none> and password file <none>
I20260809 02:20:05.759356 21431 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:05.759411 21431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:05.759521 21431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:05.760722 21431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "adcf9cceb2164df491cc8dabfd9ad8f6"
format_stamp: "Formatted at 2026-08-09 02:20:05 on dist-test-slave-w206"
server_key: "e801c6bc4218dd6d2428b0d197aae09e"
server_key_iv: "2a4d374cc4441903eed2f711391f0d02"
server_key_version: "encryptionkey@0"
I20260809 02:20:05.761071 21431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "adcf9cceb2164df491cc8dabfd9ad8f6"
format_stamp: "Formatted at 2026-08-09 02:20:05 on dist-test-slave-w206"
server_key: "e801c6bc4218dd6d2428b0d197aae09e"
server_key_iv: "2a4d374cc4441903eed2f711391f0d02"
server_key_version: "encryptionkey@0"
I20260809 02:20:05.762537 21431 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:20:05.763473 21447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:05.763661 21431 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 02:20:05.763759 21431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "adcf9cceb2164df491cc8dabfd9ad8f6"
format_stamp: "Formatted at 2026-08-09 02:20:05 on dist-test-slave-w206"
server_key: "e801c6bc4218dd6d2428b0d197aae09e"
server_key_iv: "2a4d374cc4441903eed2f711391f0d02"
server_key_version: "encryptionkey@0"
I20260809 02:20:05.763823 21431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:05.770838 21431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:05.771171 21431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:05.771286 21431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:05.775484 21431 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:41185
I20260809 02:20:05.775521 21503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:41185 every 8 connection(s)
I20260809 02:20:05.775885 21431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:20:05.776599 21504 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:05.779330 21504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P adcf9cceb2164df491cc8dabfd9ad8f6: Bootstrap starting.
I20260809 02:20:05.779965 21504 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P adcf9cceb2164df491cc8dabfd9ad8f6: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:05.780279 21504 log.cc:824] T 00000000000000000000000000000000 P adcf9cceb2164df491cc8dabfd9ad8f6: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:05.780967 21504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P adcf9cceb2164df491cc8dabfd9ad8f6: No bootstrap required, opened a new log
I20260809 02:20:05.782589 21504 raft_consensus.cc:348] T 00000000000000000000000000000000 P adcf9cceb2164df491cc8dabfd9ad8f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adcf9cceb2164df491cc8dabfd9ad8f6" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41185 } }
I20260809 02:20:05.782729 21504 raft_consensus.cc:374] T 00000000000000000000000000000000 P adcf9cceb2164df491cc8dabfd9ad8f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:05.782757 21504 raft_consensus.cc:729] T 00000000000000000000000000000000 P adcf9cceb2164df491cc8dabfd9ad8f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adcf9cceb2164df491cc8dabfd9ad8f6, State: Initialized, Role: FOLLOWER
I20260809 02:20:05.782935 21504 consensus_queue.cc:260] T 00000000000000000000000000000000 P adcf9cceb2164df491cc8dabfd9ad8f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adcf9cceb2164df491cc8dabfd9ad8f6" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41185 } }
I20260809 02:20:05.783070 21504 raft_consensus.cc:388] T 00000000000000000000000000000000 P adcf9cceb2164df491cc8dabfd9ad8f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:20:05.783095 21504 raft_consensus.cc:482] T 00000000000000000000000000000000 P adcf9cceb2164df491cc8dabfd9ad8f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:20:05.783162 21504 raft_consensus.cc:3037] T 00000000000000000000000000000000 P adcf9cceb2164df491cc8dabfd9ad8f6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:05.783794 21504 raft_consensus.cc:504] T 00000000000000000000000000000000 P adcf9cceb2164df491cc8dabfd9ad8f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adcf9cceb2164df491cc8dabfd9ad8f6" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41185 } }
I20260809 02:20:05.783819 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 21431
I20260809 02:20:05.783919 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:20:05.783922 21504 leader_election.cc:302] T 00000000000000000000000000000000 P adcf9cceb2164df491cc8dabfd9ad8f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: adcf9cceb2164df491cc8dabfd9ad8f6; no voters:
I20260809 02:20:05.784106 21504 leader_election.cc:288] T 00000000000000000000000000000000 P adcf9cceb2164df491cc8dabfd9ad8f6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:20:05.784144 11638 external_mini_cluster.cc:1428] Setting key c22bec966832f7470e029afbbd80cab4
I20260809 02:20:05.784180 21507 raft_consensus.cc:2781] T 00000000000000000000000000000000 P adcf9cceb2164df491cc8dabfd9ad8f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:20:05.784397 21507 raft_consensus.cc:686] T 00000000000000000000000000000000 P adcf9cceb2164df491cc8dabfd9ad8f6 [term 1 LEADER]: Becoming Leader. State: Replica: adcf9cceb2164df491cc8dabfd9ad8f6, State: Running, Role: LEADER
I20260809 02:20:05.784420 21504 sys_catalog.cc:564] T 00000000000000000000000000000000 P adcf9cceb2164df491cc8dabfd9ad8f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:20:05.784509 21507 consensus_queue.cc:237] T 00000000000000000000000000000000 P adcf9cceb2164df491cc8dabfd9ad8f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adcf9cceb2164df491cc8dabfd9ad8f6" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41185 } }
I20260809 02:20:05.784883 21507 sys_catalog.cc:455] T 00000000000000000000000000000000 P adcf9cceb2164df491cc8dabfd9ad8f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader adcf9cceb2164df491cc8dabfd9ad8f6. Latest consensus state: current_term: 1 leader_uuid: "adcf9cceb2164df491cc8dabfd9ad8f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adcf9cceb2164df491cc8dabfd9ad8f6" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41185 } } }
I20260809 02:20:05.784993 21507 sys_catalog.cc:458] T 00000000000000000000000000000000 P adcf9cceb2164df491cc8dabfd9ad8f6 [sys.catalog]: This master's current role is: LEADER
I20260809 02:20:05.785162 21508 sys_catalog.cc:455] T 00000000000000000000000000000000 P adcf9cceb2164df491cc8dabfd9ad8f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "adcf9cceb2164df491cc8dabfd9ad8f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adcf9cceb2164df491cc8dabfd9ad8f6" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41185 } } }
I20260809 02:20:05.785251 21519 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:20:05.785284 21508 sys_catalog.cc:458] T 00000000000000000000000000000000 P adcf9cceb2164df491cc8dabfd9ad8f6 [sys.catalog]: This master's current role is: LEADER
I20260809 02:20:05.785861 21519 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:20:05.787557 21519 catalog_manager.cc:1347] Generated new cluster ID: aceda81997c64d6f918dce32194a7124
I20260809 02:20:05.787613 21519 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:20:05.791276 21513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:05.784862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51270 (local address 127.11.93.190:41185)
0809 02:20:05.785696 (+ 834us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:05.785706 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:05.785743 (+ 37us) server_negotiation.cc:407] Connection header received
0809 02:20:05.785889 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:05.785897 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:05.785981 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:05.786191 (+ 210us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:05.786404 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:05.787972 (+ 1568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:05.789102 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:05.789693 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:05.789799 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:05.790556 (+ 757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:05.790560 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:05.790560 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:20:05.790761 (+ 201us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:05.790801 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:20:05.790814 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:05.790878 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:05.791001 (+ 123us) server_negotiation.cc:299] Negotiation successful
0809 02:20:05.791078 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":747,"thread_start_us":81,"threads_started":1}
I20260809 02:20:05.796663 21519 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:20:05.797350 21519 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:20:05.802232 21519 catalog_manager.cc:5868] T 00000000000000000000000000000000 P adcf9cceb2164df491cc8dabfd9ad8f6: Generated new TSK 0
I20260809 02:20:05.802456 21519 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:20:05.808146 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:41185
--builtin_ntp_servers=127.11.93.148:44699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 02:20:05.896546 21531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:05.896813 21531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:05.896852 21531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:05.898036 21531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:05.898108 21531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:05.898149 21531 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:20:05.899578 21531 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:44699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:41185
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21531
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:20:05.899889 21531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:05.900257 21531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:05.905367 21536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:05.905491 21537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:05.905349 21540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:05.905742 21531 server_base.cc:1034] running on GCE node
I20260809 02:20:05.905985 21531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:05.906241 21531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:05.907408 21531 hybrid_clock.cc:648] HybridClock initialized: now 1786242005907394 us; error 33 us; skew 500 ppm
I20260809 02:20:05.908771 21531 webserver.cc:460] Webserver started at http://127.11.93.129:37171/ using document root <none> and password file <none>
I20260809 02:20:05.909044 21531 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:05.909121 21531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:05.909296 21531 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:05.910444 21531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "e13664d9d9ee4c2ea37130858c20ad9f"
format_stamp: "Formatted at 2026-08-09 02:20:05 on dist-test-slave-w206"
server_key: "ece1a9f2c277c69a539172a13468dcc6"
server_key_iv: "29f20cb63e71f605acd144e2a7699ab7"
server_key_version: "encryptionkey@0"
I20260809 02:20:05.910849 21531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "e13664d9d9ee4c2ea37130858c20ad9f"
format_stamp: "Formatted at 2026-08-09 02:20:05 on dist-test-slave-w206"
server_key: "ece1a9f2c277c69a539172a13468dcc6"
server_key_iv: "29f20cb63e71f605acd144e2a7699ab7"
server_key_version: "encryptionkey@0"
I20260809 02:20:05.912384 21531 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:20:05.913235 21546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:05.913441 21531 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:20:05.913530 21531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "e13664d9d9ee4c2ea37130858c20ad9f"
format_stamp: "Formatted at 2026-08-09 02:20:05 on dist-test-slave-w206"
server_key: "ece1a9f2c277c69a539172a13468dcc6"
server_key_iv: "29f20cb63e71f605acd144e2a7699ab7"
server_key_version: "encryptionkey@0"
I20260809 02:20:05.913627 21531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:05.938767 21531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:05.939155 21531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:05.939328 21531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:05.939592 21531 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:20:05.939973 21531 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:05.940030 21531 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:05.940073 21531 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:05.940116 21531 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:05.946094 21531 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:45605
I20260809 02:20:05.946142 21667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:45605 every 8 connection(s)
I20260809 02:20:05.946491 21531 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:20:05.951844 21513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:05.947241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:43863 (local address 127.11.93.190:41185)
0809 02:20:05.947316 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:05.947317 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:05.947577 (+ 260us) server_negotiation.cc:407] Connection header received
0809 02:20:05.948065 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:05.948066 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:05.948078 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:05.948141 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:05.948813 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:05.949311 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:05.950449 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:05.950637 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:05.950690 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:05.951571 (+ 881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:05.951573 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:05.951573 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:20:05.951578 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:05.951596 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:20:05.951601 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:05.951663 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:05.951742 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 02:20:05.951784 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:20:05.952032 21670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:05.947218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:41185 (local address 127.11.93.129:43863)
0809 02:20:05.947432 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:05.947476 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:05.947979 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:05.948219 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:05.948222 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:05.948231 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:05.948734 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:05.948738 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:05.949448 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:05.949448 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:05.950362 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:05.950365 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:05.950716 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:05.950717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:05.950823 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:05.951426 (+ 603us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:20:05.951426 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:05.951456 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:20:05.951479 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:05.951669 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:05.951674 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:05.951676 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 02:20:05.951728 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 02:20:05.951807 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":110,"threads_started":1}
I20260809 02:20:05.952543 21668 heartbeater.cc:347] Connected to a master server at 127.11.93.190:41185
I20260809 02:20:05.952627 21668 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:05.952831 21668 heartbeater.cc:511] Master 127.11.93.190:41185 requested a full tablet report, sending...
I20260809 02:20:05.953373 21464 ts_manager.cc:194] Registered new tserver with Master: e13664d9d9ee4c2ea37130858c20ad9f (127.11.93.129:45605)
I20260809 02:20:05.954041 21464 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.93.129:43863
I20260809 02:20:05.954775 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 21531
I20260809 02:20:05.954864 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:20:05.955083 11638 external_mini_cluster.cc:1428] Setting key c6cb83d8e85decb079bb588b1e42f6ec
I20260809 02:20:05.955905 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:41185
--builtin_ntp_servers=127.11.93.148:44699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 02:20:06.038210 21671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:06.038470 21671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:06.038506 21671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:06.039808 21671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:06.039875 21671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:06.039933 21671 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:20:06.041283 21671 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:44699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:41185
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:20:06.041571 21671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:06.041875 21671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:06.046890 21678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:06.047003 21681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:06.047047 21679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:06.047158 21671 server_base.cc:1034] running on GCE node
I20260809 02:20:06.047484 21671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:06.047739 21671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:06.048856 21671 hybrid_clock.cc:648] HybridClock initialized: now 1786242006048835 us; error 39 us; skew 500 ppm
I20260809 02:20:06.050123 21671 webserver.cc:460] Webserver started at http://127.11.93.130:46653/ using document root <none> and password file <none>
I20260809 02:20:06.050357 21671 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:06.050401 21671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:06.050496 21671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:06.051687 21671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "d50b59789b5241dfb6ba346ab219201b"
format_stamp: "Formatted at 2026-08-09 02:20:06 on dist-test-slave-w206"
server_key: "5c3d69bbc8814886b775fadff8461c67"
server_key_iv: "21ffe5f964b73a7756022b4f6c6151af"
server_key_version: "encryptionkey@0"
I20260809 02:20:06.051998 21671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "d50b59789b5241dfb6ba346ab219201b"
format_stamp: "Formatted at 2026-08-09 02:20:06 on dist-test-slave-w206"
server_key: "5c3d69bbc8814886b775fadff8461c67"
server_key_iv: "21ffe5f964b73a7756022b4f6c6151af"
server_key_version: "encryptionkey@0"
I20260809 02:20:06.053383 21671 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:20:06.054108 21687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:06.054292 21671 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:20:06.054394 21671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "d50b59789b5241dfb6ba346ab219201b"
format_stamp: "Formatted at 2026-08-09 02:20:06 on dist-test-slave-w206"
server_key: "5c3d69bbc8814886b775fadff8461c67"
server_key_iv: "21ffe5f964b73a7756022b4f6c6151af"
server_key_version: "encryptionkey@0"
I20260809 02:20:06.054483 21671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:06.089010 21671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:06.089378 21671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:06.089540 21671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:06.089813 21671 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:20:06.090173 21671 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:06.090230 21671 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:06.090284 21671 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:06.090312 21671 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:06.096163 21671 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:40451
I20260809 02:20:06.096256 21805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:40451 every 8 connection(s)
I20260809 02:20:06.096716 21671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:20:06.101699 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 21671
I20260809 02:20:06.101825 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:20:06.102056 11638 external_mini_cluster.cc:1428] Setting key 76174391e2ab62ac9d5fd0f5d26c364d
I20260809 02:20:06.102396 21513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:06.097575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:54413 (local address 127.11.93.190:41185)
0809 02:20:06.097624 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:06.097626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:06.097998 (+ 372us) server_negotiation.cc:407] Connection header received
0809 02:20:06.098501 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:06.098502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:06.098512 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:06.098575 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:06.099339 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:06.099835 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:06.100855 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:06.101041 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:06.101092 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:06.102027 (+ 935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:06.102029 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:06.102030 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:20:06.102035 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:06.102053 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:20:06.102057 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:06.102131 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:06.102241 (+ 110us) server_negotiation.cc:299] Negotiation successful
0809 02:20:06.102290 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 02:20:06.102581 21809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:06.097535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:41185 (local address 127.11.93.130:54413)
0809 02:20:06.097877 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:06.097912 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:06.098415 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:06.098629 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:06.098632 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:06.098640 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:06.099256 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:06.099263 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:06.099948 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:06.099949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:06.100778 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:06.100781 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:06.101113 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:06.101114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:06.101223 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:06.101851 (+ 628us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:20:06.101851 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:06.101893 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:20:06.101922 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:06.102148 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:06.102155 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:06.102159 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:20:06.102229 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 02:20:06.102338 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":99,"threads_started":1}
I20260809 02:20:06.103188 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:41185
--builtin_ntp_servers=127.11.93.148:44699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 02:20:06.103184 21806 heartbeater.cc:347] Connected to a master server at 127.11.93.190:41185
I20260809 02:20:06.103307 21806 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:06.103498 21806 heartbeater.cc:511] Master 127.11.93.190:41185 requested a full tablet report, sending...
I20260809 02:20:06.103876 21464 ts_manager.cc:194] Registered new tserver with Master: d50b59789b5241dfb6ba346ab219201b (127.11.93.130:40451)
I20260809 02:20:06.104209 21464 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.93.130:54413
W20260809 02:20:06.189926 21811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:06.190143 21811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:06.190165 21811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:06.191288 21811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:06.191320 21811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:06.191344 21811 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:20:06.192595 21811 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:44699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:41185
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21811
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:20:06.192804 21811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:06.193055 21811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:06.198055 21816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:06.198061 21819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:06.198061 21817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:06.198431 21811 server_base.cc:1034] running on GCE node
I20260809 02:20:06.198659 21811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:06.198880 21811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:06.200037 21811 hybrid_clock.cc:648] HybridClock initialized: now 1786242006200013 us; error 39 us; skew 500 ppm
I20260809 02:20:06.201339 21811 webserver.cc:460] Webserver started at http://127.11.93.131:34513/ using document root <none> and password file <none>
I20260809 02:20:06.201537 21811 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:06.201579 21811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:06.201673 21811 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:06.202720 21811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "be55f6ea30da43ce8e1adfa075e664b4"
format_stamp: "Formatted at 2026-08-09 02:20:06 on dist-test-slave-w206"
server_key: "6c844c7f7051cf2e780ac5a2e547d90b"
server_key_iv: "661e7a6b834dd442511e0d6c3097c0fe"
server_key_version: "encryptionkey@0"
I20260809 02:20:06.203095 21811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "be55f6ea30da43ce8e1adfa075e664b4"
format_stamp: "Formatted at 2026-08-09 02:20:06 on dist-test-slave-w206"
server_key: "6c844c7f7051cf2e780ac5a2e547d90b"
server_key_iv: "661e7a6b834dd442511e0d6c3097c0fe"
server_key_version: "encryptionkey@0"
I20260809 02:20:06.204396 21811 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:20:06.205130 21825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:06.205307 21811 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:20:06.205399 21811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "be55f6ea30da43ce8e1adfa075e664b4"
format_stamp: "Formatted at 2026-08-09 02:20:06 on dist-test-slave-w206"
server_key: "6c844c7f7051cf2e780ac5a2e547d90b"
server_key_iv: "661e7a6b834dd442511e0d6c3097c0fe"
server_key_version: "encryptionkey@0"
I20260809 02:20:06.205456 21811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:06.223560 21811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:06.223857 21811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:06.223971 21811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:06.224175 21811 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:20:06.224604 21811 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:06.224674 21811 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:06.224710 21811 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:06.224738 21811 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:06.230638 21811 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:34279
I20260809 02:20:06.230742 21945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:34279 every 8 connection(s)
I20260809 02:20:06.231105 21811 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:20:06.239164 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 21811
I20260809 02:20:06.239276 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:20:06.239503 11638 external_mini_cluster.cc:1428] Setting key 46ae66555a7be5045220ef88cf6df321
I20260809 02:20:06.240772 21513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:06.231953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:45583 (local address 127.11.93.190:41185)
0809 02:20:06.232036 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:06.232038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:06.235342 (+ 3304us) server_negotiation.cc:407] Connection header received
0809 02:20:06.235904 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:06.235906 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:06.235919 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:06.235963 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:06.236950 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:06.237514 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:06.239161 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:06.239359 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:06.239469 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:06.240493 (+ 1024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:06.240494 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:06.240495 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:20:06.240500 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:06.240519 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:20:06.240524 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:06.240586 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:06.240678 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 02:20:06.240707 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 02:20:06.241046 21948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:06.231926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:41185 (local address 127.11.93.131:45583)
0809 02:20:06.235186 (+ 3260us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:06.235234 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:06.235788 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:06.236046 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:06.236051 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:06.236061 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:06.236823 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:06.236832 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:06.237613 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:06.237615 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:06.239061 (+ 1446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:06.239068 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:06.239478 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:06.239480 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:06.239629 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:06.240319 (+ 690us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:20:06.240320 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:06.240351 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:20:06.240376 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:06.240601 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:06.240607 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:06.240611 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:20:06.240683 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 02:20:06.240774 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3184,"thread_start_us":80,"threads_started":1}
I20260809 02:20:06.241520 21946 heartbeater.cc:347] Connected to a master server at 127.11.93.190:41185
I20260809 02:20:06.241624 21946 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:06.241819 21946 heartbeater.cc:511] Master 127.11.93.190:41185 requested a full tablet report, sending...
I20260809 02:20:06.242339 21464 ts_manager.cc:194] Registered new tserver with Master: be55f6ea30da43ce8e1adfa075e664b4 (127.11.93.131:34279)
I20260809 02:20:06.242735 21464 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.93.131:45583
I20260809 02:20:06.251508 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 02:20:06.253450 21513 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:20:06.252765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51278 (local address 127.11.93.190:41185)
0809 02:20:06.252809 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:06.252810 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:06.253021 (+ 211us) server_negotiation.cc:407] Connection header received
0809 02:20:06.253102 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:06.253104 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:06.253117 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:06.253189 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:06.253340 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51278: BlockingRecv error: recv got EOF from 127.0.0.1:51278 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 02:20:06.253494 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 21531
I20260809 02:20:06.260644 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 21671
I20260809 02:20:06.266840 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 21811
I20260809 02:20:06.274718 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 21431
2026-08-09T02:20:06Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (645 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-09T02:20:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:20:06Z Disabled control of system clock
I20260809 02:20:06.304207 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:38189
--webserver_interface=127.11.93.190
--webserver_port=0
--builtin_ntp_servers=127.11.93.148:33049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:38189
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 02:20:06.387696 21957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:06.387914 21957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:06.387938 21957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:06.389124 21957 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:20:06.389178 21957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:06.389194 21957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:06.389207 21957 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:20:06.389271 21957 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:20:06.390646 21957 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:33049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:38189
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:38189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21957
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:20:06.390923 21957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:06.391249 21957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:06.396260 21967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:06.396236 21963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:06.396323 21965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:06.396433 21957 server_base.cc:1034] running on GCE node
I20260809 02:20:06.396811 21957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:06.397099 21957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:06.398272 21957 hybrid_clock.cc:648] HybridClock initialized: now 1786242006398238 us; error 60 us; skew 500 ppm
I20260809 02:20:06.399613 21957 webserver.cc:460] Webserver started at http://127.11.93.190:38065/ using document root <none> and password file <none>
I20260809 02:20:06.399890 21957 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:06.399986 21957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:06.400142 21957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:06.401232 21957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "98c8bc2867204cf586d4bcfc00a684ee"
format_stamp: "Formatted at 2026-08-09 02:20:06 on dist-test-slave-w206"
server_key: "2b82f78d461418668cc77c0c3ac288e7"
server_key_iv: "eedeef307627631d12e036efe21916e8"
server_key_version: "encryptionkey@0"
I20260809 02:20:06.401599 21957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "98c8bc2867204cf586d4bcfc00a684ee"
format_stamp: "Formatted at 2026-08-09 02:20:06 on dist-test-slave-w206"
server_key: "2b82f78d461418668cc77c0c3ac288e7"
server_key_iv: "eedeef307627631d12e036efe21916e8"
server_key_version: "encryptionkey@0"
I20260809 02:20:06.402967 21957 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 02:20:06.403911 21973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:06.404095 21957 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:20:06.404242 21957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "98c8bc2867204cf586d4bcfc00a684ee"
format_stamp: "Formatted at 2026-08-09 02:20:06 on dist-test-slave-w206"
server_key: "2b82f78d461418668cc77c0c3ac288e7"
server_key_iv: "eedeef307627631d12e036efe21916e8"
server_key_version: "encryptionkey@0"
I20260809 02:20:06.404340 21957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:06.407910 21957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:06.408196 21957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:06.408354 21957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:06.412556 21957 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:38189
I20260809 02:20:06.412585 22031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:38189 every 8 connection(s)
I20260809 02:20:06.412947 21957 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:20:06.413638 22032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:06.416491 22032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98c8bc2867204cf586d4bcfc00a684ee: Bootstrap starting.
I20260809 02:20:06.417024 22032 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 98c8bc2867204cf586d4bcfc00a684ee: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:06.417270 22032 log.cc:824] T 00000000000000000000000000000000 P 98c8bc2867204cf586d4bcfc00a684ee: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:06.417981 22032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98c8bc2867204cf586d4bcfc00a684ee: No bootstrap required, opened a new log
I20260809 02:20:06.418627 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 21957
I20260809 02:20:06.418735 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:20:06.418942 11638 external_mini_cluster.cc:1428] Setting key 01a8dda76c3e324ca6ed562610e8a2cd
I20260809 02:20:06.420131 22032 raft_consensus.cc:348] T 00000000000000000000000000000000 P 98c8bc2867204cf586d4bcfc00a684ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98c8bc2867204cf586d4bcfc00a684ee" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38189 } }
I20260809 02:20:06.420313 22032 raft_consensus.cc:374] T 00000000000000000000000000000000 P 98c8bc2867204cf586d4bcfc00a684ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:06.420357 22032 raft_consensus.cc:729] T 00000000000000000000000000000000 P 98c8bc2867204cf586d4bcfc00a684ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98c8bc2867204cf586d4bcfc00a684ee, State: Initialized, Role: FOLLOWER
I20260809 02:20:06.420855 22032 consensus_queue.cc:260] T 00000000000000000000000000000000 P 98c8bc2867204cf586d4bcfc00a684ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98c8bc2867204cf586d4bcfc00a684ee" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38189 } }
I20260809 02:20:06.420979 22032 raft_consensus.cc:388] T 00000000000000000000000000000000 P 98c8bc2867204cf586d4bcfc00a684ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:20:06.421020 22032 raft_consensus.cc:482] T 00000000000000000000000000000000 P 98c8bc2867204cf586d4bcfc00a684ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:20:06.421095 22032 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 98c8bc2867204cf586d4bcfc00a684ee [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:06.421710 22036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:06.419579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35052 (local address 127.11.93.190:38189)
0809 02:20:06.419820 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:06.419828 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:06.419856 (+ 28us) server_negotiation.cc:407] Connection header received
0809 02:20:06.420093 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:06.420098 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:06.420133 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:06.420252 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:06.421040 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:06.421044 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:06.421044 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:20:06.421049 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:06.421109 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:20:06.421125 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:06.421207 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:06.421288 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 02:20:06.421346 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":119,"threads_started":1}
I20260809 02:20:06.421746 22032 raft_consensus.cc:504] T 00000000000000000000000000000000 P 98c8bc2867204cf586d4bcfc00a684ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98c8bc2867204cf586d4bcfc00a684ee" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38189 } }
I20260809 02:20:06.421880 22032 leader_election.cc:302] T 00000000000000000000000000000000 P 98c8bc2867204cf586d4bcfc00a684ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 98c8bc2867204cf586d4bcfc00a684ee; no voters:
I20260809 02:20:06.422060 22032 leader_election.cc:288] T 00000000000000000000000000000000 P 98c8bc2867204cf586d4bcfc00a684ee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:20:06.422092 22037 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 98c8bc2867204cf586d4bcfc00a684ee [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:20:06.422201 22037 raft_consensus.cc:686] T 00000000000000000000000000000000 P 98c8bc2867204cf586d4bcfc00a684ee [term 1 LEADER]: Becoming Leader. State: Replica: 98c8bc2867204cf586d4bcfc00a684ee, State: Running, Role: LEADER
I20260809 02:20:06.422283 22037 consensus_queue.cc:237] T 00000000000000000000000000000000 P 98c8bc2867204cf586d4bcfc00a684ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98c8bc2867204cf586d4bcfc00a684ee" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38189 } }
I20260809 02:20:06.422318 22032 sys_catalog.cc:564] T 00000000000000000000000000000000 P 98c8bc2867204cf586d4bcfc00a684ee [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:20:06.422621 22039 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98c8bc2867204cf586d4bcfc00a684ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 98c8bc2867204cf586d4bcfc00a684ee. Latest consensus state: current_term: 1 leader_uuid: "98c8bc2867204cf586d4bcfc00a684ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98c8bc2867204cf586d4bcfc00a684ee" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38189 } } }
I20260809 02:20:06.422713 22039 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98c8bc2867204cf586d4bcfc00a684ee [sys.catalog]: This master's current role is: LEADER
I20260809 02:20:06.422879 22038 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98c8bc2867204cf586d4bcfc00a684ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "98c8bc2867204cf586d4bcfc00a684ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98c8bc2867204cf586d4bcfc00a684ee" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38189 } } }
I20260809 02:20:06.422941 22038 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98c8bc2867204cf586d4bcfc00a684ee [sys.catalog]: This master's current role is: LEADER
I20260809 02:20:06.423245 22042 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:20:06.423760 22042 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:20:06.425240 22042 catalog_manager.cc:1347] Generated new cluster ID: d8ed4bfcc8c9484e81a15e0848a2375a
I20260809 02:20:06.425303 22042 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:20:06.435737 22042 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:20:06.435947 22042 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:20:06.441635 22042 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 98c8bc2867204cf586d4bcfc00a684ee: Generated new TSK 0
I20260809 02:20:06.441859 22042 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:20:06.446833 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:38189
--builtin_ntp_servers=127.11.93.148:33049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 02:20:06.533207 22056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:06.533456 22056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:06.533499 22056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:06.534699 22056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:06.534770 22056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:06.534814 22056 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:20:06.536278 22056 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:33049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:38189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:20:06.536556 22056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:06.536860 22056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:06.542137 22064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:06.542163 22062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:06.542133 22061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:06.542495 22056 server_base.cc:1034] running on GCE node
I20260809 02:20:06.542726 22056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:06.543021 22056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:06.544188 22056 hybrid_clock.cc:648] HybridClock initialized: now 1786242006544177 us; error 39 us; skew 500 ppm
I20260809 02:20:06.545559 22056 webserver.cc:460] Webserver started at http://127.11.93.129:45089/ using document root <none> and password file <none>
I20260809 02:20:06.545837 22056 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:06.545914 22056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:06.546079 22056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:06.547305 22056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "ceee2e122bc34033874cc702f0ef8bd7"
format_stamp: "Formatted at 2026-08-09 02:20:06 on dist-test-slave-w206"
server_key: "c1a82902b636d74d3437ec75c97cab14"
server_key_iv: "28c9b63860b64193c93fd2db138d63f9"
server_key_version: "encryptionkey@0"
I20260809 02:20:06.547689 22056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "ceee2e122bc34033874cc702f0ef8bd7"
format_stamp: "Formatted at 2026-08-09 02:20:06 on dist-test-slave-w206"
server_key: "c1a82902b636d74d3437ec75c97cab14"
server_key_iv: "28c9b63860b64193c93fd2db138d63f9"
server_key_version: "encryptionkey@0"
I20260809 02:20:06.549099 22056 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:20:06.549933 22071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:06.550118 22056 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:20:06.550227 22056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "ceee2e122bc34033874cc702f0ef8bd7"
format_stamp: "Formatted at 2026-08-09 02:20:06 on dist-test-slave-w206"
server_key: "c1a82902b636d74d3437ec75c97cab14"
server_key_iv: "28c9b63860b64193c93fd2db138d63f9"
server_key_version: "encryptionkey@0"
I20260809 02:20:06.550305 22056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:06.553714 22056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:06.554033 22056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:06.554186 22056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:06.554416 22056 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:20:06.554737 22056 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:06.554801 22056 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:06.554841 22056 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:06.554865 22056 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:06.560720 22056 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:33555
I20260809 02:20:06.560832 22192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:33555 every 8 connection(s)
I20260809 02:20:06.561151 22056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:20:06.564229 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 22056
I20260809 02:20:06.564356 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:20:06.564564 22036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:06.561978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:55141 (local address 127.11.93.190:38189)
0809 02:20:06.562050 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:06.562052 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:06.562287 (+ 235us) server_negotiation.cc:407] Connection header received
0809 02:20:06.562759 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:06.562760 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:06.562766 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:06.562833 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:06.564176 (+ 1343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:06.564178 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:06.564178 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:20:06.564183 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:06.564201 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:20:06.564205 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:06.564258 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:06.564489 (+ 231us) server_negotiation.cc:299] Negotiation successful
0809 02:20:06.564506 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:20:06.564580 11638 external_mini_cluster.cc:1428] Setting key eb8203289c1cfd671e1dc65fe356813e
I20260809 02:20:06.564790 22195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:06.561948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:38189 (local address 127.11.93.129:55141)
0809 02:20:06.562140 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:06.562182 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:06.562669 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:06.562887 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:06.562890 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:06.562898 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:06.563935 (+ 1037us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:20:06.563936 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:06.564003 (+ 67us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:20:06.564056 (+ 53us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:06.564330 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:06.564340 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:06.564344 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:20:06.564473 (+ 129us) client_negotiation.cc:240] Negotiation successful
0809 02:20:06.564552 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":92,"threads_started":1}
I20260809 02:20:06.565429 22193 heartbeater.cc:347] Connected to a master server at 127.11.93.190:38189
I20260809 02:20:06.565547 22193 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:06.565665 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:38189
--builtin_ntp_servers=127.11.93.148:33049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 02:20:06.565742 22193 heartbeater.cc:511] Master 127.11.93.190:38189 requested a full tablet report, sending...
I20260809 02:20:06.566322 21992 ts_manager.cc:194] Registered new tserver with Master: ceee2e122bc34033874cc702f0ef8bd7 (127.11.93.129:33555)
W20260809 02:20:06.650738 22197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:06.651058 22197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:06.651087 22197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:06.652228 22197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:06.652269 22197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:06.652295 22197 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:20:06.653633 22197 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:33049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:38189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22197
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:20:06.653829 22197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:06.654134 22197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:06.659463 22202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:06.659600 22197 server_base.cc:1034] running on GCE node
W20260809 02:20:06.659469 22205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:06.659477 22203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:06.659970 22197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:06.660239 22197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:06.661422 22197 hybrid_clock.cc:648] HybridClock initialized: now 1786242006661409 us; error 31 us; skew 500 ppm
I20260809 02:20:06.662755 22197 webserver.cc:460] Webserver started at http://127.11.93.130:42071/ using document root <none> and password file <none>
I20260809 02:20:06.663076 22197 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:06.663151 22197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:06.663317 22197 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:06.664449 22197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "27a5178d8e8942d5839b9349eb30c534"
format_stamp: "Formatted at 2026-08-09 02:20:06 on dist-test-slave-w206"
server_key: "ca66801df78445baca9f3e3055afae12"
server_key_iv: "ed9f5073ebf116247383faf6aabda6c2"
server_key_version: "encryptionkey@0"
I20260809 02:20:06.664839 22197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "27a5178d8e8942d5839b9349eb30c534"
format_stamp: "Formatted at 2026-08-09 02:20:06 on dist-test-slave-w206"
server_key: "ca66801df78445baca9f3e3055afae12"
server_key_iv: "ed9f5073ebf116247383faf6aabda6c2"
server_key_version: "encryptionkey@0"
I20260809 02:20:06.666287 22197 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:20:06.667157 22212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:06.667421 22197 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:20:06.667533 22197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "27a5178d8e8942d5839b9349eb30c534"
format_stamp: "Formatted at 2026-08-09 02:20:06 on dist-test-slave-w206"
server_key: "ca66801df78445baca9f3e3055afae12"
server_key_iv: "ed9f5073ebf116247383faf6aabda6c2"
server_key_version: "encryptionkey@0"
I20260809 02:20:06.667611 22197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:06.671064 22197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:06.671339 22197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:06.671486 22197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:06.671706 22197 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:20:06.672026 22197 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:06.672081 22197 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:06.672122 22197 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:06.672149 22197 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:06.677982 22197 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:45567
I20260809 02:20:06.678023 22337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:45567 every 8 connection(s)
I20260809 02:20:06.678375 22197 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:20:06.681547 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 22197
I20260809 02:20:06.681638 22036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:06.679249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:55623 (local address 127.11.93.190:38189)
0809 02:20:06.679321 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:06.679323 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:06.679560 (+ 237us) server_negotiation.cc:407] Connection header received
0809 02:20:06.680069 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:06.680070 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:06.680076 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:06.680131 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:06.681316 (+ 1185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:06.681319 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:06.681319 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:20:06.681324 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:06.681350 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:20:06.681356 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:06.681423 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:06.681517 (+ 94us) server_negotiation.cc:299] Negotiation successful
0809 02:20:06.681536 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 02:20:06.681658 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:20:06.681810 22340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:06.679241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:38189 (local address 127.11.93.130:55623)
0809 02:20:06.679428 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:06.679464 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:06.679968 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:06.680186 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:06.680189 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:06.680197 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:06.681112 (+ 915us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:20:06.681112 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:06.681144 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:20:06.681175 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:06.681430 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:06.681435 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:06.681437 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 02:20:06.681500 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 02:20:06.681554 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":96,"threads_started":1}
I20260809 02:20:06.681902 11638 external_mini_cluster.cc:1428] Setting key e04caa37ddae6f90e0b5141a7f858438
I20260809 02:20:06.682300 22338 heartbeater.cc:347] Connected to a master server at 127.11.93.190:38189
I20260809 02:20:06.682402 22338 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:06.682550 22338 heartbeater.cc:511] Master 127.11.93.190:38189 requested a full tablet report, sending...
I20260809 02:20:06.683022 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:38189
--builtin_ntp_servers=127.11.93.148:33049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 02:20:06.683029 21992 ts_manager.cc:194] Registered new tserver with Master: 27a5178d8e8942d5839b9349eb30c534 (127.11.93.130:45567)
W20260809 02:20:06.766429 22341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:06.766646 22341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:06.766669 22341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:06.767882 22341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:06.767925 22341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:06.767951 22341 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:20:06.769323 22341 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:33049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:38189
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:20:06.769583 22341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:06.769886 22341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:06.775334 22349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:06.775394 22347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:06.775372 22346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:06.775614 22341 server_base.cc:1034] running on GCE node
I20260809 02:20:06.775835 22341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:06.776037 22341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:06.777177 22341 hybrid_clock.cc:648] HybridClock initialized: now 1786242006777163 us; error 29 us; skew 500 ppm
I20260809 02:20:06.778533 22341 webserver.cc:460] Webserver started at http://127.11.93.131:35507/ using document root <none> and password file <none>
I20260809 02:20:06.778774 22341 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:06.778818 22341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:06.778968 22341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:06.780148 22341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "cf20d0b4f0fb47abba90dd039f6b5666"
format_stamp: "Formatted at 2026-08-09 02:20:06 on dist-test-slave-w206"
server_key: "8be420ae5a2c5d6b5b14d1b0406c854c"
server_key_iv: "8f0bffb22619d47ed5673efd61db8836"
server_key_version: "encryptionkey@0"
I20260809 02:20:06.780529 22341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "cf20d0b4f0fb47abba90dd039f6b5666"
format_stamp: "Formatted at 2026-08-09 02:20:06 on dist-test-slave-w206"
server_key: "8be420ae5a2c5d6b5b14d1b0406c854c"
server_key_iv: "8f0bffb22619d47ed5673efd61db8836"
server_key_version: "encryptionkey@0"
I20260809 02:20:06.781852 22341 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:20:06.782545 22355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:06.782706 22341 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:20:06.782812 22341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "cf20d0b4f0fb47abba90dd039f6b5666"
format_stamp: "Formatted at 2026-08-09 02:20:06 on dist-test-slave-w206"
server_key: "8be420ae5a2c5d6b5b14d1b0406c854c"
server_key_iv: "8f0bffb22619d47ed5673efd61db8836"
server_key_version: "encryptionkey@0"
I20260809 02:20:06.782884 22341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:06.786226 22341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:06.786504 22341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:06.786674 22341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:06.786914 22341 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:20:06.787261 22341 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:06.787294 22341 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:06.787348 22341 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:06.787375 22341 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:06.793179 22341 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:38669
I20260809 02:20:06.793226 22476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:38669 every 8 connection(s)
I20260809 02:20:06.793558 22341 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:20:06.796495 22036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:06.794318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:49965 (local address 127.11.93.190:38189)
0809 02:20:06.794392 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:06.794398 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:06.794625 (+ 227us) server_negotiation.cc:407] Connection header received
0809 02:20:06.795145 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:06.795146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:06.795153 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:06.795218 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:06.796302 (+ 1084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:06.796304 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:06.796304 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:20:06.796308 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:06.796322 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:20:06.796326 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:06.796375 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:06.796425 (+ 50us) server_negotiation.cc:299] Negotiation successful
0809 02:20:06.796440 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 02:20:06.796685 22480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:06.794294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:38189 (local address 127.11.93.131:49965)
0809 02:20:06.794492 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:06.794533 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:06.795048 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:06.795270 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:06.795274 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:06.795282 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:06.796150 (+ 868us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:20:06.796150 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:06.796178 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:20:06.796206 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:06.796372 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:06.796375 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:06.796377 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 02:20:06.796432 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 02:20:06.796479 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":103,"threads_started":1}
I20260809 02:20:06.797145 22477 heartbeater.cc:347] Connected to a master server at 127.11.93.190:38189
I20260809 02:20:06.797283 22477 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:06.797463 22477 heartbeater.cc:511] Master 127.11.93.190:38189 requested a full tablet report, sending...
I20260809 02:20:06.797808 21992 ts_manager.cc:194] Registered new tserver with Master: cf20d0b4f0fb47abba90dd039f6b5666 (127.11.93.131:38669)
I20260809 02:20:06.798584 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 22341
I20260809 02:20:06.798658 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:20:06.798864 11638 external_mini_cluster.cc:1428] Setting key a1ce0a8470067741713efb9a6a46af66
I20260809 02:20:06.799805 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 02:20:06.801698 22036 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:20:06.801238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35062 (local address 127.11.93.190:38189)
0809 02:20:06.801304 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:06.801306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:06.801363 (+ 57us) server_negotiation.cc:407] Connection header received
0809 02:20:06.801434 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:06.801434 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:06.801439 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:06.801485 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:06.801635 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35062: BlockingRecv error: recv got EOF from 127.0.0.1:35062 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:20:06.801785 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 22056
I20260809 02:20:06.807557 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 22197
I20260809 02:20:06.816617 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 22341
I20260809 02:20:06.821666 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 21957
2026-08-09T02:20:06Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (546 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:20:06 dist-test-slave-w206 krb5kdc[22488](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:20:06 dist-test-slave-w206 krb5kdc[22488](info): set up 2 sockets
Aug 09 02:20:06 dist-test-slave-w206 krb5kdc[22488](info): commencing operation
krb5kdc: starting...
W20260809 02:20:07.894757 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:20:07 dist-test-slave-w206 krb5kdc[22488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:20:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:20:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:20:08.022761 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:46777
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:36113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:46777
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:08.105638 22502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:08.105883 22502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:08.105921 22502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:08.107077 22502 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:20:08.107146 22502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:08.107169 22502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:08.107191 22502 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:20:08.107218 22502 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:20:08.108693 22502 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:36113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:46777
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:46777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22502
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:20:08.108965 22502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:08.109187 22502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:08.114130 22507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:08.114115 22511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:08.114147 22509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:08.114638 22502 server_base.cc:1034] running on GCE node
I20260809 02:20:08.114929 22502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:08.115310 22502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:08.116514 22502 hybrid_clock.cc:648] HybridClock initialized: now 1786242008116484 us; error 39 us; skew 500 ppm
Aug 09 02:20:08 dist-test-slave-w206 krb5kdc[22488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242008, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:08.119366 22502 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:20:08.119859 22502 webserver.cc:460] Webserver started at http://127.11.93.190:45713/ using document root <none> and password file <none>
I20260809 02:20:08.120129 22502 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:08.120208 22502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:08.120375 22502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:08.121482 22502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "5851a1b9ebe84ccbb0ab7e80cafaa7a0"
format_stamp: "Formatted at 2026-08-09 02:20:08 on dist-test-slave-w206"
server_key: "2d8c2ee38aa90278948ea9b9161045a9"
server_key_iv: "f0faa28096f6f23604e704bce2cc9633"
server_key_version: "encryptionkey@0"
I20260809 02:20:08.121881 22502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "5851a1b9ebe84ccbb0ab7e80cafaa7a0"
format_stamp: "Formatted at 2026-08-09 02:20:08 on dist-test-slave-w206"
server_key: "2d8c2ee38aa90278948ea9b9161045a9"
server_key_iv: "f0faa28096f6f23604e704bce2cc9633"
server_key_version: "encryptionkey@0"
I20260809 02:20:08.123498 22502 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:20:08.124498 22519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:08.124687 22502 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:20:08.124805 22502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "5851a1b9ebe84ccbb0ab7e80cafaa7a0"
format_stamp: "Formatted at 2026-08-09 02:20:08 on dist-test-slave-w206"
server_key: "2d8c2ee38aa90278948ea9b9161045a9"
server_key_iv: "f0faa28096f6f23604e704bce2cc9633"
server_key_version: "encryptionkey@0"
I20260809 02:20:08.124886 22502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:08.150244 22502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:08.152812 22502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:08.152990 22502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:08.157133 22502 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:46777
I20260809 02:20:08.157189 22574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:46777 every 8 connection(s)
I20260809 02:20:08.157593 22502 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:20:08.158248 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 22502
I20260809 02:20:08.158365 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:20:08.158612 11638 external_mini_cluster.cc:1428] Setting key 07a604c9a0832852bea483933c3a6f83
I20260809 02:20:08.158924 22575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:08.161978 22575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0: Bootstrap starting.
I20260809 02:20:08.162644 22575 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:08.163022 22575 log.cc:824] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:08.163769 22575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0: No bootstrap required, opened a new log
Aug 09 02:20:08 dist-test-slave-w206 krb5kdc[22488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:20:08.165707 22575 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5851a1b9ebe84ccbb0ab7e80cafaa7a0" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46777 } }
I20260809 02:20:08.165877 22575 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:08.165966 22575 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5851a1b9ebe84ccbb0ab7e80cafaa7a0, State: Initialized, Role: FOLLOWER
I20260809 02:20:08.166128 22575 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5851a1b9ebe84ccbb0ab7e80cafaa7a0" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46777 } }
I20260809 02:20:08.166229 22575 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:20:08.166275 22575 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:20:08.166323 22575 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:08.166929 22575 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5851a1b9ebe84ccbb0ab7e80cafaa7a0" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46777 } }
I20260809 02:20:08.167083 22575 leader_election.cc:302] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5851a1b9ebe84ccbb0ab7e80cafaa7a0; no voters:
I20260809 02:20:08.167337 22575 leader_election.cc:288] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:20:08.167373 22580 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:20:08.167533 22580 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0 [term 1 LEADER]: Becoming Leader. State: Replica: 5851a1b9ebe84ccbb0ab7e80cafaa7a0, State: Running, Role: LEADER
I20260809 02:20:08.167629 22580 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5851a1b9ebe84ccbb0ab7e80cafaa7a0" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46777 } }
I20260809 02:20:08.167630 22575 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:20:08.168005 22581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5851a1b9ebe84ccbb0ab7e80cafaa7a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5851a1b9ebe84ccbb0ab7e80cafaa7a0" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46777 } } }
I20260809 02:20:08.168085 22581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0 [sys.catalog]: This master's current role is: LEADER
I20260809 02:20:08.168234 22582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5851a1b9ebe84ccbb0ab7e80cafaa7a0. Latest consensus state: current_term: 1 leader_uuid: "5851a1b9ebe84ccbb0ab7e80cafaa7a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5851a1b9ebe84ccbb0ab7e80cafaa7a0" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46777 } } }
I20260809 02:20:08.168292 22582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0 [sys.catalog]: This master's current role is: LEADER
I20260809 02:20:08.168411 22584 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:20:08.169229 22584 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:20:08.170274 22578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:08.159175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56856 (local address 127.11.93.190:46777)
0809 02:20:08.159384 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:08.159394 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:08.159431 (+ 37us) server_negotiation.cc:407] Connection header received
0809 02:20:08.160140 (+ 709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:08.160147 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:08.160199 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:08.160358 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:08.160985 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.161891 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.162709 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.163298 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.163428 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:08.165846 (+ 2418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:08.165851 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:08.165851 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:08.165871 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:08.168194 (+ 2323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:08.168696 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:08.168699 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:08.168700 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:08.168825 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:08.169079 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:08.169080 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:08.169080 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:08.169447 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:08.169694 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:08.169945 (+ 251us) server_negotiation.cc:299] Negotiation successful
0809 02:20:08.170094 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":93,"threads_started":1}
I20260809 02:20:08.170804 22584 catalog_manager.cc:1347] Generated new cluster ID: 78ec0452c9f04a55a90e11576d3db464
I20260809 02:20:08.170853 22584 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:20:08.176810 22584 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:20:08.177666 22584 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:20:08.184113 22584 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0: Generated new TSK 0
I20260809 02:20:08.184305 22584 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.93.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
I20260809 02:20:08.218283 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:46777
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:36113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:08.305320 22601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:08.305536 22601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:08.305560 22601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:08.306733 22601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:08.306777 22601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:08.306828 22601 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:20:08.308342 22601 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:36113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:46777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:20:08.308604 22601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:08.308861 22601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:08.313815 22607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:08.313800 22609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:08.313819 22606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:08.314200 22601 server_base.cc:1034] running on GCE node
I20260809 02:20:08.314407 22601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:08.314646 22601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:08.315812 22601 hybrid_clock.cc:648] HybridClock initialized: now 1786242008315805 us; error 37 us; skew 500 ppm
Aug 09 02:20:08 dist-test-slave-w206 krb5kdc[22488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242008, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:08.318413 22601 init.cc:377] Logged in from keytab as kudu/127.11.93.129@KRBTEST.COM (short username kudu)
I20260809 02:20:08.318877 22601 webserver.cc:460] Webserver started at http://127.11.93.129:33281/ using document root <none> and password file <none>
I20260809 02:20:08.319170 22601 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:08.319243 22601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:08.319394 22601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:08.320546 22601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "7903062200c6410c9ae23c4a58396666"
format_stamp: "Formatted at 2026-08-09 02:20:08 on dist-test-slave-w206"
server_key: "a2c07e15f3e4057b3a538dcce9a3dd86"
server_key_iv: "94f8c0e70db7a0c86d768f9fd808c312"
server_key_version: "encryptionkey@0"
I20260809 02:20:08.320950 22601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "7903062200c6410c9ae23c4a58396666"
format_stamp: "Formatted at 2026-08-09 02:20:08 on dist-test-slave-w206"
server_key: "a2c07e15f3e4057b3a538dcce9a3dd86"
server_key_iv: "94f8c0e70db7a0c86d768f9fd808c312"
server_key_version: "encryptionkey@0"
I20260809 02:20:08.322359 22601 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:20:08.323140 22616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:08.323369 22601 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:20:08.323506 22601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "7903062200c6410c9ae23c4a58396666"
format_stamp: "Formatted at 2026-08-09 02:20:08 on dist-test-slave-w206"
server_key: "a2c07e15f3e4057b3a538dcce9a3dd86"
server_key_iv: "94f8c0e70db7a0c86d768f9fd808c312"
server_key_version: "encryptionkey@0"
I20260809 02:20:08.323586 22601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:08.334523 22601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:08.336480 22601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:08.336652 22601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:08.336890 22601 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:20:08.337229 22601 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:08.337286 22601 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:08.337328 22601 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:08.337353 22601 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:08.343365 22601 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:40847
I20260809 02:20:08.343406 22736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:40847 every 8 connection(s)
I20260809 02:20:08.343745 22601 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:20:08.347748 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 22601
I20260809 02:20:08.347852 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:20:08.348047 11638 external_mini_cluster.cc:1428] Setting key 88ea543fd9ce2f511079a7e6c389f7ac
Aug 09 02:20:08 dist-test-slave-w206 krb5kdc[22488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242008, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:20:08.353669 22578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:08.344547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:47549 (local address 127.11.93.190:46777)
0809 02:20:08.344616 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:08.344618 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:08.344818 (+ 200us) server_negotiation.cc:407] Connection header received
0809 02:20:08.345278 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:08.345279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:08.345289 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:08.345352 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:08.346253 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.346758 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.347971 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.348221 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.348307 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:08.350523 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:08.350524 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:08.350524 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:08.350532 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:08.351990 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:08.352426 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:08.352428 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:08.352428 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:08.352493 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:08.352760 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:08.352761 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:08.352761 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:08.352946 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:08.353015 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:08.353424 (+ 409us) server_negotiation.cc:299] Negotiation successful
0809 02:20:08.353534 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:20:08.354166 22739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:08.344499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:46777 (local address 127.11.93.129:47549)
0809 02:20:08.344675 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:08.344715 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:08.345198 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:08.345401 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:08.345404 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:08.345986 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:08.346174 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:08.346179 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.346845 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.346846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:08.347871 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:08.347874 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.348316 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.348317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:08.348490 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:08.349046 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:08.349054 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:08.350414 (+ 1360us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:08.352090 (+ 1676us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:08.352097 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:08.352099 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:08.352323 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:08.352564 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:08.352565 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:08.352565 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:08.352681 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:08.353049 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:08.353057 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:08.353234 (+ 177us) client_negotiation.cc:769] Sending connection context
0809 02:20:08.353779 (+ 545us) client_negotiation.cc:240] Negotiation successful
0809 02:20:08.353974 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":91,"threads_started":1}
I20260809 02:20:08.354815 22737 heartbeater.cc:347] Connected to a master server at 127.11.93.190:46777
I20260809 02:20:08.354899 22737 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:08.355093 22737 heartbeater.cc:511] Master 127.11.93.190:46777 requested a full tablet report, sending...
I20260809 02:20:08.355623 22536 ts_manager.cc:194] Registered new tserver with Master: 7903062200c6410c9ae23c4a58396666 (127.11.93.129:40847)
I20260809 02:20:08.356249 22536 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:47549
WARNING: no policy specified for kudu/127.11.93.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
I20260809 02:20:08.377894 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:46777
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:36113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:08.461856 22743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:08.462059 22743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:08.462081 22743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:08.463239 22743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:08.463284 22743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:08.463335 22743 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:20:08.464805 22743 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:36113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:46777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22743
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:20:08.465035 22743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:08.465260 22743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:08.470526 22748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:08.470520 22749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:08.470521 22751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:08.470537 22743 server_base.cc:1034] running on GCE node
I20260809 02:20:08.471029 22743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:08.471275 22743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:08.472453 22743 hybrid_clock.cc:648] HybridClock initialized: now 1786242008472440 us; error 36 us; skew 500 ppm
Aug 09 02:20:08 dist-test-slave-w206 krb5kdc[22488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242008, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:08.474931 22743 init.cc:377] Logged in from keytab as kudu/127.11.93.130@KRBTEST.COM (short username kudu)
I20260809 02:20:08.475379 22743 webserver.cc:460] Webserver started at http://127.11.93.130:36899/ using document root <none> and password file <none>
I20260809 02:20:08.475617 22743 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:08.475687 22743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:08.475844 22743 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:08.476943 22743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "9467092d83fe49298727c46c3c8ea6b3"
format_stamp: "Formatted at 2026-08-09 02:20:08 on dist-test-slave-w206"
server_key: "3a7c5fa01acc0a98bb6215ab988b3d27"
server_key_iv: "5e10fb75acc6cf1c2a270b049638ef7f"
server_key_version: "encryptionkey@0"
I20260809 02:20:08.477303 22743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "9467092d83fe49298727c46c3c8ea6b3"
format_stamp: "Formatted at 2026-08-09 02:20:08 on dist-test-slave-w206"
server_key: "3a7c5fa01acc0a98bb6215ab988b3d27"
server_key_iv: "5e10fb75acc6cf1c2a270b049638ef7f"
server_key_version: "encryptionkey@0"
I20260809 02:20:08.478622 22743 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:20:08.479409 22758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:08.479578 22743 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:08.479684 22743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "9467092d83fe49298727c46c3c8ea6b3"
format_stamp: "Formatted at 2026-08-09 02:20:08 on dist-test-slave-w206"
server_key: "3a7c5fa01acc0a98bb6215ab988b3d27"
server_key_iv: "5e10fb75acc6cf1c2a270b049638ef7f"
server_key_version: "encryptionkey@0"
I20260809 02:20:08.479758 22743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:08.489332 22743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:08.491168 22743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:08.491321 22743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:08.491587 22743 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:20:08.491899 22743 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:08.491953 22743 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:08.491995 22743 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:08.492020 22743 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:08.497701 22743 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:34213
I20260809 02:20:08.497809 22877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:34213 every 8 connection(s)
I20260809 02:20:08.498107 22743 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:20:08.503400 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 22743
I20260809 02:20:08.503490 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:20:08.503687 11638 external_mini_cluster.cc:1428] Setting key 1056758a30e620b291483f81b2a1170d
Aug 09 02:20:08 dist-test-slave-w206 krb5kdc[22488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242008, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:20:08.508415 22578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:08.498873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:37593 (local address 127.11.93.190:46777)
0809 02:20:08.498921 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:08.498923 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:08.499169 (+ 246us) server_negotiation.cc:407] Connection header received
0809 02:20:08.499652 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:08.499654 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:08.499665 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:08.499718 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:08.500656 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.501163 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.502164 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.502366 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.502435 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:08.505085 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:08.505086 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:08.505087 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:08.505096 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:08.506710 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:08.507323 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:08.507324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:08.507325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:08.507388 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:08.507722 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:08.507722 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:08.507722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:08.507844 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:08.507898 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:08.508259 (+ 361us) server_negotiation.cc:299] Negotiation successful
0809 02:20:08.508348 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 02:20:08.508701 22881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:08.498832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:46777 (local address 127.11.93.130:37593)
0809 02:20:08.499045 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:08.499081 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:08.499566 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:08.499771 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:08.499775 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:08.500367 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:08.500573 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:08.500578 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.501252 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.501253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:08.502057 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:08.502060 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.502464 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.502465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:08.502575 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:08.503170 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:08.503178 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:08.504979 (+ 1801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:08.506823 (+ 1844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:08.506832 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:08.506835 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:08.507239 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:08.507466 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:08.507467 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:08.507468 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:08.507643 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:08.507910 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:08.507917 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:08.508102 (+ 185us) client_negotiation.cc:769] Sending connection context
0809 02:20:08.508216 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 02:20:08.508403 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":92,"threads_started":1}
I20260809 02:20:08.509302 22878 heartbeater.cc:347] Connected to a master server at 127.11.93.190:46777
I20260809 02:20:08.509414 22878 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:08.509621 22878 heartbeater.cc:511] Master 127.11.93.190:46777 requested a full tablet report, sending...
I20260809 02:20:08.510080 22536 ts_manager.cc:194] Registered new tserver with Master: 9467092d83fe49298727c46c3c8ea6b3 (127.11.93.130:34213)
I20260809 02:20:08.510488 22536 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:37593
WARNING: no policy specified for kudu/127.11.93.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
I20260809 02:20:08.533813 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:46777
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:36113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:08.616446 22884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:08.616690 22884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:08.616725 22884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:08.617878 22884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:08.617944 22884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:08.617988 22884 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:20:08.619474 22884 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:36113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:46777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22884
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:20:08.619745 22884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:08.619992 22884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:08.625582 22889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:08.625598 22890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:08.625667 22884 server_base.cc:1034] running on GCE node
W20260809 02:20:08.625598 22892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:08.626093 22884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:08.626376 22884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:08.627540 22884 hybrid_clock.cc:648] HybridClock initialized: now 1786242008627517 us; error 66 us; skew 500 ppm
Aug 09 02:20:08 dist-test-slave-w206 krb5kdc[22488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242008, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:08.630174 22884 init.cc:377] Logged in from keytab as kudu/127.11.93.131@KRBTEST.COM (short username kudu)
I20260809 02:20:08.630642 22884 webserver.cc:460] Webserver started at http://127.11.93.131:35381/ using document root <none> and password file <none>
I20260809 02:20:08.630868 22884 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:08.630918 22884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:08.631098 22884 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:20:08.632265 22884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "3524566a35bc4816bd29f7d0c8f35df1"
format_stamp: "Formatted at 2026-08-09 02:20:08 on dist-test-slave-w206"
server_key: "2cf75179302a1fa37557ff78778d5623"
server_key_iv: "21259fb65d2a2ab163563e4f6ee4ef61"
server_key_version: "encryptionkey@0"
I20260809 02:20:08.632632 22884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "3524566a35bc4816bd29f7d0c8f35df1"
format_stamp: "Formatted at 2026-08-09 02:20:08 on dist-test-slave-w206"
server_key: "2cf75179302a1fa37557ff78778d5623"
server_key_iv: "21259fb65d2a2ab163563e4f6ee4ef61"
server_key_version: "encryptionkey@0"
I20260809 02:20:08.634063 22884 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:20:08.634836 22899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:08.635161 22884 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:20:08.635277 22884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "3524566a35bc4816bd29f7d0c8f35df1"
format_stamp: "Formatted at 2026-08-09 02:20:08 on dist-test-slave-w206"
server_key: "2cf75179302a1fa37557ff78778d5623"
server_key_iv: "21259fb65d2a2ab163563e4f6ee4ef61"
server_key_version: "encryptionkey@0"
I20260809 02:20:08.635355 22884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:08.650518 22884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:08.652649 22884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:08.652809 22884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:08.653052 22884 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:20:08.653378 22884 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:08.653445 22884 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:08.653488 22884 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:08.653513 22884 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:08.659363 22884 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:44897
I20260809 02:20:08.659415 23019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:44897 every 8 connection(s)
I20260809 02:20:08.659739 22884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
Aug 09 02:20:08 dist-test-slave-w206 krb5kdc[22488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242008, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:20:08.669412 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 22884
I20260809 02:20:08.669562 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:20:08.669850 11638 external_mini_cluster.cc:1428] Setting key 06dd7b531a0035895f7dd5525da77c09
I20260809 02:20:08.669953 22578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:08.660650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:48927 (local address 127.11.93.190:46777)
0809 02:20:08.660768 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:08.660770 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:08.660882 (+ 112us) server_negotiation.cc:407] Connection header received
0809 02:20:08.661353 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:08.661354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:08.661365 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:08.661428 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:08.662350 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.662869 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.663894 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.664164 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.664251 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:08.666396 (+ 2145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:08.666398 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:08.666398 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:08.666407 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:08.668360 (+ 1953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:08.668762 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:08.668763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:08.668763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:08.668851 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:08.669112 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:08.669113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:08.669113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:08.669291 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:08.669399 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:08.669729 (+ 330us) server_negotiation.cc:299] Negotiation successful
0809 02:20:08.669836 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 02:20:08.670125 23022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:08.660561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:46777 (local address 127.11.93.131:48927)
0809 02:20:08.660740 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:08.660783 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:08.661265 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:08.661479 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:08.661483 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:08.662058 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:08.662246 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:08.662250 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.662953 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.662954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:08.663807 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:08.663809 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.664272 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.664273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:08.664372 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:08.664921 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:08.664940 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:08.666301 (+ 1361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:08.668456 (+ 2155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:08.668462 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:08.668464 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:08.668687 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:08.668934 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:08.668935 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:08.668935 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:08.669036 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:08.669383 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:08.669387 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:08.669531 (+ 144us) client_negotiation.cc:769] Sending connection context
0809 02:20:08.669692 (+ 161us) client_negotiation.cc:240] Negotiation successful
0809 02:20:08.669839 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":104,"threads_started":1}
I20260809 02:20:08.670790 23020 heartbeater.cc:347] Connected to a master server at 127.11.93.190:46777
I20260809 02:20:08.670897 23020 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:08.671124 23020 heartbeater.cc:511] Master 127.11.93.190:46777 requested a full tablet report, sending...
I20260809 02:20:08.671518 22536 ts_manager.cc:194] Registered new tserver with Master: 3524566a35bc4816bd29f7d0c8f35df1 (127.11.93.131:44897)
I20260809 02:20:08.671909 22536 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:48927
I20260809 02:20:08.682005 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:20:08.689554 22578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:08.683514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56858 (local address 127.11.93.190:46777)
0809 02:20:08.683580 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:08.683583 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:08.683666 (+ 83us) server_negotiation.cc:407] Connection header received
0809 02:20:08.683702 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:08.683703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:08.683713 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:08.683756 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:08.684403 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.684956 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.685630 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.685804 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.685854 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:08.687228 (+ 1374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:08.687229 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:08.687230 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:08.687254 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:08.688485 (+ 1231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:08.688795 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:08.688795 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:08.688796 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:08.688848 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:08.689020 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:08.689020 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:08.689020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:08.689156 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:08.689292 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:08.689328 (+ 36us) server_negotiation.cc:299] Negotiation successful
0809 02:20:08.689412 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 02:20:08.691190 22536 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56858:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:20:08.692792 22536 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:20:08.700368 23031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:08.695460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:34213 (local address 127.0.0.1:39698)
0809 02:20:08.695978 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:08.695990 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:08.696082 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:08.696361 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:08.696362 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:08.696364 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:08.696416 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:08.696418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.697828 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.697829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:08.699034 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:08.699037 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.700047 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.700048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:08.700112 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:08.700123 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 02:20:08.700195 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 02:20:08.700246 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"mutex_wait_us":74,"thread_start_us":87,"threads_started":1}
I20260809 02:20:08.700695 23034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:08.695661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39698 (local address 127.11.93.130:34213)
0809 02:20:08.695909 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:08.695913 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:08.696049 (+ 136us) server_negotiation.cc:407] Connection header received
0809 02:20:08.696249 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:08.696252 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:08.696273 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:08.696351 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:08.696495 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.697692 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.699149 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.699942 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.700029 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:08.700094 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:08.700233 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 02:20:08.700291 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":101,"threads_started":1}
I20260809 02:20:08.701011 23035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:08.695670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:44897 (local address 127.0.0.1:37460)
0809 02:20:08.695994 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:08.696006 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:08.696059 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:08.696572 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:08.696573 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:08.696575 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:08.696636 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:08.696638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.697687 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.697688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:08.699304 (+ 1616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:08.699306 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.700353 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.700354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:08.700804 (+ 450us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:08.700813 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 02:20:08.700872 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 02:20:08.700918 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":46,"thread_start_us":106,"threads_started":1}
I20260809 02:20:08.701253 23036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:08.695926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37460 (local address 127.11.93.131:44897)
0809 02:20:08.696392 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:08.696398 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:08.696410 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:20:08.696456 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:08.696458 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:08.696479 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:08.696576 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:08.696717 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.697534 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.699409 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.700230 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.700319 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:08.700376 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:08.701121 (+ 745us) server_negotiation.cc:299] Negotiation successful
0809 02:20:08.701167 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":94,"threads_started":1}
I20260809 02:20:08.701467 22808 tablet_service.cc:1467] Processing CreateTablet for tablet 21ae8e555591441584f534837154c893 (DEFAULT_TABLE table=test-table [id=abe2c5a1aafa46a1a5eb83ccbddad62f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:08.701699 23032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:08.695457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:40847 (local address 127.0.0.1:48126)
0809 02:20:08.695603 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:08.695645 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:08.695715 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:08.696131 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:08.696135 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:08.696137 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:08.696217 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:08.696220 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.697940 (+ 1720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.697941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:08.699302 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:08.699306 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.701448 (+ 2142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.701449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:08.701516 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:08.701520 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:20:08.701578 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 02:20:08.701623 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":45,"thread_start_us":57,"threads_started":1}
I20260809 02:20:08.701747 23033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:08.695562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48126 (local address 127.11.93.129:40847)
0809 02:20:08.695827 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:08.695833 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:08.695849 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:20:08.695899 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:08.695902 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:08.695923 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:08.696030 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:08.696433 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.697697 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.700419 (+ 2722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.701283 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.701349 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:08.701413 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:08.701619 (+ 206us) server_negotiation.cc:299] Negotiation successful
0809 02:20:08.701665 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":134,"threads_started":1}
I20260809 02:20:08.701900 22808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21ae8e555591441584f534837154c893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:08.701952 22948 tablet_service.cc:1467] Processing CreateTablet for tablet 21ae8e555591441584f534837154c893 (DEFAULT_TABLE table=test-table [id=abe2c5a1aafa46a1a5eb83ccbddad62f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:08.702219 22948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21ae8e555591441584f534837154c893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:08.703771 22668 tablet_service.cc:1467] Processing CreateTablet for tablet 21ae8e555591441584f534837154c893 (DEFAULT_TABLE table=test-table [id=abe2c5a1aafa46a1a5eb83ccbddad62f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:08.704150 22668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21ae8e555591441584f534837154c893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:08.704949 23037 tablet_bootstrap.cc:492] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3: Bootstrap starting.
I20260809 02:20:08.705577 23037 tablet_bootstrap.cc:654] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:08.705865 23038 tablet_bootstrap.cc:492] T 21ae8e555591441584f534837154c893 P 3524566a35bc4816bd29f7d0c8f35df1: Bootstrap starting.
I20260809 02:20:08.706153 23037 log.cc:824] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:08.706583 23038 tablet_bootstrap.cc:654] T 21ae8e555591441584f534837154c893 P 3524566a35bc4816bd29f7d0c8f35df1: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:08.706904 23037 tablet_bootstrap.cc:492] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3: No bootstrap required, opened a new log
I20260809 02:20:08.707013 23037 ts_tablet_manager.cc:1397] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:20:08.707278 23038 log.cc:824] T 21ae8e555591441584f534837154c893 P 3524566a35bc4816bd29f7d0c8f35df1: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:08.707803 23041 tablet_bootstrap.cc:492] T 21ae8e555591441584f534837154c893 P 7903062200c6410c9ae23c4a58396666: Bootstrap starting.
I20260809 02:20:08.708135 23038 tablet_bootstrap.cc:492] T 21ae8e555591441584f534837154c893 P 3524566a35bc4816bd29f7d0c8f35df1: No bootstrap required, opened a new log
I20260809 02:20:08.708211 23038 ts_tablet_manager.cc:1397] T 21ae8e555591441584f534837154c893 P 3524566a35bc4816bd29f7d0c8f35df1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:20:08.708455 23041 tablet_bootstrap.cc:654] T 21ae8e555591441584f534837154c893 P 7903062200c6410c9ae23c4a58396666: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:08.708971 23041 log.cc:824] T 21ae8e555591441584f534837154c893 P 7903062200c6410c9ae23c4a58396666: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:08.708999 23037 raft_consensus.cc:348] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7903062200c6410c9ae23c4a58396666" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 40847 } } peers { permanent_uuid: "9467092d83fe49298727c46c3c8ea6b3" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 34213 } } peers { permanent_uuid: "3524566a35bc4816bd29f7d0c8f35df1" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 44897 } }
I20260809 02:20:08.709252 23037 raft_consensus.cc:374] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:08.709301 23037 raft_consensus.cc:729] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9467092d83fe49298727c46c3c8ea6b3, State: Initialized, Role: FOLLOWER
I20260809 02:20:08.709421 23037 consensus_queue.cc:260] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7903062200c6410c9ae23c4a58396666" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 40847 } } peers { permanent_uuid: "9467092d83fe49298727c46c3c8ea6b3" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 34213 } } peers { permanent_uuid: "3524566a35bc4816bd29f7d0c8f35df1" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 44897 } }
I20260809 02:20:08.709702 23037 ts_tablet_manager.cc:1428] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 02:20:08.709764 22878 heartbeater.cc:503] Master 127.11.93.190:46777 was elected leader, sending a full tablet report...
I20260809 02:20:08.710143 23041 tablet_bootstrap.cc:492] T 21ae8e555591441584f534837154c893 P 7903062200c6410c9ae23c4a58396666: No bootstrap required, opened a new log
I20260809 02:20:08.710219 23041 ts_tablet_manager.cc:1397] T 21ae8e555591441584f534837154c893 P 7903062200c6410c9ae23c4a58396666: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:20:08.710119 23038 raft_consensus.cc:348] T 21ae8e555591441584f534837154c893 P 3524566a35bc4816bd29f7d0c8f35df1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7903062200c6410c9ae23c4a58396666" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 40847 } } peers { permanent_uuid: "9467092d83fe49298727c46c3c8ea6b3" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 34213 } } peers { permanent_uuid: "3524566a35bc4816bd29f7d0c8f35df1" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 44897 } }
I20260809 02:20:08.710300 23038 raft_consensus.cc:374] T 21ae8e555591441584f534837154c893 P 3524566a35bc4816bd29f7d0c8f35df1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:08.710348 23038 raft_consensus.cc:729] T 21ae8e555591441584f534837154c893 P 3524566a35bc4816bd29f7d0c8f35df1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3524566a35bc4816bd29f7d0c8f35df1, State: Initialized, Role: FOLLOWER
I20260809 02:20:08.710454 23038 consensus_queue.cc:260] T 21ae8e555591441584f534837154c893 P 3524566a35bc4816bd29f7d0c8f35df1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7903062200c6410c9ae23c4a58396666" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 40847 } } peers { permanent_uuid: "9467092d83fe49298727c46c3c8ea6b3" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 34213 } } peers { permanent_uuid: "3524566a35bc4816bd29f7d0c8f35df1" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 44897 } }
I20260809 02:20:08.710764 23038 ts_tablet_manager.cc:1428] T 21ae8e555591441584f534837154c893 P 3524566a35bc4816bd29f7d0c8f35df1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 02:20:08.710896 23020 heartbeater.cc:503] Master 127.11.93.190:46777 was elected leader, sending a full tablet report...
I20260809 02:20:08.712226 23041 raft_consensus.cc:348] T 21ae8e555591441584f534837154c893 P 7903062200c6410c9ae23c4a58396666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7903062200c6410c9ae23c4a58396666" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 40847 } } peers { permanent_uuid: "9467092d83fe49298727c46c3c8ea6b3" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 34213 } } peers { permanent_uuid: "3524566a35bc4816bd29f7d0c8f35df1" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 44897 } }
I20260809 02:20:08.712368 23041 raft_consensus.cc:374] T 21ae8e555591441584f534837154c893 P 7903062200c6410c9ae23c4a58396666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:08.712391 23041 raft_consensus.cc:729] T 21ae8e555591441584f534837154c893 P 7903062200c6410c9ae23c4a58396666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7903062200c6410c9ae23c4a58396666, State: Initialized, Role: FOLLOWER
I20260809 02:20:08.712515 23041 consensus_queue.cc:260] T 21ae8e555591441584f534837154c893 P 7903062200c6410c9ae23c4a58396666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7903062200c6410c9ae23c4a58396666" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 40847 } } peers { permanent_uuid: "9467092d83fe49298727c46c3c8ea6b3" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 34213 } } peers { permanent_uuid: "3524566a35bc4816bd29f7d0c8f35df1" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 44897 } }
I20260809 02:20:08.712812 23041 ts_tablet_manager.cc:1428] T 21ae8e555591441584f534837154c893 P 7903062200c6410c9ae23c4a58396666: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 02:20:08.712875 22737 heartbeater.cc:503] Master 127.11.93.190:46777 was elected leader, sending a full tablet report...
W20260809 02:20:08.748672 22879 tablet.cc:2369] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:20:08.836884 23043 raft_consensus.cc:482] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:20:08.837013 23043 raft_consensus.cc:504] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7903062200c6410c9ae23c4a58396666" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 40847 } } peers { permanent_uuid: "9467092d83fe49298727c46c3c8ea6b3" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 34213 } } peers { permanent_uuid: "3524566a35bc4816bd29f7d0c8f35df1" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 44897 } }
I20260809 02:20:08.837361 23043 leader_election.cc:288] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7903062200c6410c9ae23c4a58396666 (127.11.93.129:40847), 3524566a35bc4816bd29f7d0c8f35df1 (127.11.93.131:44897)
I20260809 02:20:08.840626 23033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:08.837686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:48155 (local address 127.11.93.129:40847)
0809 02:20:08.837744 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:08.837746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:08.837932 (+ 186us) server_negotiation.cc:407] Connection header received
0809 02:20:08.837960 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:08.837961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:08.837969 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:08.838041 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:08.838189 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.838865 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.839884 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.840266 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.840353 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:08.840362 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:08.840520 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 02:20:08.840555 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 02:20:08.840629 23036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:08.837661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:57239 (local address 127.11.93.131:44897)
0809 02:20:08.837712 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:08.837715 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:08.837728 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:20:08.837775 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:08.837776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:08.837786 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:08.837847 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:08.838035 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.838824 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.839892 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.840281 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.840366 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:08.840375 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:08.840525 (+ 150us) server_negotiation.cc:299] Negotiation successful
0809 02:20:08.840563 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 02:20:08.840639 22881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:08.837570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:44897 (local address 127.11.93.130:57239)
0809 02:20:08.837643 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:08.837655 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:08.837705 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:08.837869 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:08.837870 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:08.837872 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:08.837955 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:08.837957 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.838929 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.838930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:08.839786 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:08.839788 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.840365 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.840366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:08.840449 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:08.840452 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:20:08.840519 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 02:20:08.840556 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":5}
I20260809 02:20:08.840646 23046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:08.837591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:40847 (local address 127.11.93.130:48155)
0809 02:20:08.837833 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:08.837843 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:08.837899 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:08.838067 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:08.838068 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:08.838069 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:08.838117 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:08.838117 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.838942 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.838943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:08.839783 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:08.839785 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.840354 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.840355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:08.840430 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:08.840434 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:20:08.840509 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 02:20:08.840550 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":79,"thread_start_us":117,"threads_started":1}
I20260809 02:20:08.841010 22688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21ae8e555591441584f534837154c893" candidate_uuid: "9467092d83fe49298727c46c3c8ea6b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7903062200c6410c9ae23c4a58396666" is_pre_election: true
I20260809 02:20:08.841027 22968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21ae8e555591441584f534837154c893" candidate_uuid: "9467092d83fe49298727c46c3c8ea6b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3524566a35bc4816bd29f7d0c8f35df1" is_pre_election: true
I20260809 02:20:08.841187 22688 raft_consensus.cc:2454] T 21ae8e555591441584f534837154c893 P 7903062200c6410c9ae23c4a58396666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9467092d83fe49298727c46c3c8ea6b3 in term 0.
I20260809 02:20:08.841197 22968 raft_consensus.cc:2454] T 21ae8e555591441584f534837154c893 P 3524566a35bc4816bd29f7d0c8f35df1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9467092d83fe49298727c46c3c8ea6b3 in term 0.
I20260809 02:20:08.841434 22761 leader_election.cc:302] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7903062200c6410c9ae23c4a58396666, 9467092d83fe49298727c46c3c8ea6b3; no voters:
I20260809 02:20:08.841616 23043 raft_consensus.cc:2781] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:20:08.841688 23043 raft_consensus.cc:482] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:20:08.841723 23043 raft_consensus.cc:3037] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:08.842553 23043 raft_consensus.cc:504] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7903062200c6410c9ae23c4a58396666" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 40847 } } peers { permanent_uuid: "9467092d83fe49298727c46c3c8ea6b3" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 34213 } } peers { permanent_uuid: "3524566a35bc4816bd29f7d0c8f35df1" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 44897 } }
I20260809 02:20:08.842703 23043 leader_election.cc:288] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3 [CANDIDATE]: Term 1 election: Requested vote from peers 7903062200c6410c9ae23c4a58396666 (127.11.93.129:40847), 3524566a35bc4816bd29f7d0c8f35df1 (127.11.93.131:44897)
I20260809 02:20:08.842873 22968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21ae8e555591441584f534837154c893" candidate_uuid: "9467092d83fe49298727c46c3c8ea6b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3524566a35bc4816bd29f7d0c8f35df1"
I20260809 02:20:08.842868 22688 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21ae8e555591441584f534837154c893" candidate_uuid: "9467092d83fe49298727c46c3c8ea6b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7903062200c6410c9ae23c4a58396666"
I20260809 02:20:08.842967 22968 raft_consensus.cc:3037] T 21ae8e555591441584f534837154c893 P 3524566a35bc4816bd29f7d0c8f35df1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:08.842965 22688 raft_consensus.cc:3037] T 21ae8e555591441584f534837154c893 P 7903062200c6410c9ae23c4a58396666 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:08.843691 22968 raft_consensus.cc:2454] T 21ae8e555591441584f534837154c893 P 3524566a35bc4816bd29f7d0c8f35df1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9467092d83fe49298727c46c3c8ea6b3 in term 1.
I20260809 02:20:08.843847 22688 raft_consensus.cc:2454] T 21ae8e555591441584f534837154c893 P 7903062200c6410c9ae23c4a58396666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9467092d83fe49298727c46c3c8ea6b3 in term 1.
I20260809 02:20:08.843871 22762 leader_election.cc:302] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3524566a35bc4816bd29f7d0c8f35df1, 9467092d83fe49298727c46c3c8ea6b3; no voters:
I20260809 02:20:08.843947 23043 raft_consensus.cc:2781] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:20:08.844110 23043 raft_consensus.cc:686] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3 [term 1 LEADER]: Becoming Leader. State: Replica: 9467092d83fe49298727c46c3c8ea6b3, State: Running, Role: LEADER
I20260809 02:20:08.844208 23043 consensus_queue.cc:237] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7903062200c6410c9ae23c4a58396666" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 40847 } } peers { permanent_uuid: "9467092d83fe49298727c46c3c8ea6b3" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 34213 } } peers { permanent_uuid: "3524566a35bc4816bd29f7d0c8f35df1" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 44897 } }
W20260809 02:20:08.844441 22738 tablet.cc:2369] T 21ae8e555591441584f534837154c893 P 7903062200c6410c9ae23c4a58396666: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:20:08.845063 22535 catalog_manager.cc:5495] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9467092d83fe49298727c46c3c8ea6b3 (127.11.93.130). New cstate: current_term: 1 leader_uuid: "9467092d83fe49298727c46c3c8ea6b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7903062200c6410c9ae23c4a58396666" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9467092d83fe49298727c46c3c8ea6b3" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 34213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3524566a35bc4816bd29f7d0c8f35df1" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 44897 } health_report { overall_health: UNKNOWN } } }
I20260809 02:20:08.885630 23034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:08.883324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39706 (local address 127.11.93.130:34213)
0809 02:20:08.883383 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:08.883385 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:08.883429 (+ 44us) server_negotiation.cc:407] Connection header received
0809 02:20:08.883564 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:08.883565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:08.883584 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:08.883658 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:20:08.883792 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.884255 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.884977 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:08.885152 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:08.885203 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:08.885348 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:20:08.885449 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:20:08.885509 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:08.885539 (+ 30us) server_negotiation.cc:299] Negotiation successful
0809 02:20:08.885555 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 02:20:08.887621 22688 raft_consensus.cc:1261] T 21ae8e555591441584f534837154c893 P 7903062200c6410c9ae23c4a58396666 [term 1 FOLLOWER]: Refusing update from remote peer 9467092d83fe49298727c46c3c8ea6b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:20:08.887621 22968 raft_consensus.cc:1261] T 21ae8e555591441584f534837154c893 P 3524566a35bc4816bd29f7d0c8f35df1 [term 1 FOLLOWER]: Refusing update from remote peer 9467092d83fe49298727c46c3c8ea6b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:20:08.888025 23043 consensus_queue.cc:1035] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3524566a35bc4816bd29f7d0c8f35df1" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 44897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:20:08.888206 23047 consensus_queue.cc:1035] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7903062200c6410c9ae23c4a58396666" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:20:08.891403 23051 mvcc.cc:205] Tried to move back new op lower bound from 7316447268400361472 to 7316447268226531328. Current Snapshot: MvccSnapshot[applied={T|T < 7316447268400361472}]
I20260809 02:20:08.892957 22536 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56858:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:20:08.893046 22536 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56858:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:20:08.893793 22536 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5851a1b9ebe84ccbb0ab7e80cafaa7a0: Sending DeleteTablet for 3 replicas of tablet 21ae8e555591441584f534837154c893
I20260809 02:20:08.894162 22808 tablet_service.cc:1514] Processing DeleteTablet for tablet 21ae8e555591441584f534837154c893 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:08 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:39698
I20260809 02:20:08.894169 22668 tablet_service.cc:1514] Processing DeleteTablet for tablet 21ae8e555591441584f534837154c893 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:08 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:48126
I20260809 02:20:08.894196 22948 tablet_service.cc:1514] Processing DeleteTablet for tablet 21ae8e555591441584f534837154c893 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:08 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:37460
I20260809 02:20:08.894423 23060 tablet_replica.cc:330] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3: stopping tablet replica
I20260809 02:20:08.894528 23060 raft_consensus.cc:2229] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:20:08.894623 23060 raft_consensus.cc:2258] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:20:08.894717 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 22601
I20260809 02:20:08.895397 23061 tablet_replica.cc:330] T 21ae8e555591441584f534837154c893 P 3524566a35bc4816bd29f7d0c8f35df1: stopping tablet replica
I20260809 02:20:08.895505 23061 raft_consensus.cc:2229] T 21ae8e555591441584f534837154c893 P 3524566a35bc4816bd29f7d0c8f35df1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:20:08.895635 23061 raft_consensus.cc:2258] T 21ae8e555591441584f534837154c893 P 3524566a35bc4816bd29f7d0c8f35df1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:20:08.896185 23060 ts_tablet_manager.cc:1905] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:20:08.898384 23060 ts_tablet_manager.cc:1918] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:20:08.898466 23060 log.cc:1196] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/21ae8e555591441584f534837154c893
I20260809 02:20:08.898761 23060 ts_tablet_manager.cc:1939] T 21ae8e555591441584f534837154c893 P 9467092d83fe49298727c46c3c8ea6b3: Deleting consensus metadata
I20260809 02:20:08.899288 22523 catalog_manager.cc:4841] TS 9467092d83fe49298727c46c3c8ea6b3 (127.11.93.130:34213): tablet 21ae8e555591441584f534837154c893 (table test-table [id=abe2c5a1aafa46a1a5eb83ccbddad62f]) successfully deleted
I20260809 02:20:08.899377 23061 ts_tablet_manager.cc:1905] T 21ae8e555591441584f534837154c893 P 3524566a35bc4816bd29f7d0c8f35df1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:20:08.901366 23061 ts_tablet_manager.cc:1918] T 21ae8e555591441584f534837154c893 P 3524566a35bc4816bd29f7d0c8f35df1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:20:08.901446 23061 log.cc:1196] T 21ae8e555591441584f534837154c893 P 3524566a35bc4816bd29f7d0c8f35df1: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/21ae8e555591441584f534837154c893
I20260809 02:20:08.901710 23061 ts_tablet_manager.cc:1939] T 21ae8e555591441584f534837154c893 P 3524566a35bc4816bd29f7d0c8f35df1: Deleting consensus metadata
I20260809 02:20:08.902207 22523 catalog_manager.cc:4841] TS 3524566a35bc4816bd29f7d0c8f35df1 (127.11.93.131:44897): tablet 21ae8e555591441584f534837154c893 (table test-table [id=abe2c5a1aafa46a1a5eb83ccbddad62f]) successfully deleted
W20260809 02:20:08.904060 22522 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.93.129:40847 (error 108)
I20260809 02:20:08.904467 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 22743
I20260809 02:20:08.904567 23032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:08.904436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:40847 (local address 127.0.0.1:48138)
0809 02:20:08.904484 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:08.904528 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.129:40847: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260809 02:20:08.907351 22522 catalog_manager.cc:4584] TS 7903062200c6410c9ae23c4a58396666 (127.11.93.129:40847): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 21ae8e555591441584f534837154c893: Network error: Client connection negotiation failed: client connection to 127.11.93.129:40847: connect: Connection refused (error 111)
I20260809 02:20:08.911270 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 22884
I20260809 02:20:08.917182 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 22502
2026-08-09T02:20:08Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2097 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:20:08 dist-test-slave-w206 krb5kdc[23066](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:20:08 dist-test-slave-w206 krb5kdc[23066](info): set up 2 sockets
Aug 09 02:20:08 dist-test-slave-w206 krb5kdc[23066](info): commencing operation
krb5kdc: starting...
W20260809 02:20:10.027333 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.088s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:20:10 dist-test-slave-w206 krb5kdc[23066](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:20:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:20:10Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.93.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.93.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.93.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/rangeradmin_127.11.93.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.93.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/rangeradmin_127.11.93.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.93.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.93.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.93.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/rangerlookup_127.11.93.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.93.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/rangerlookup_127.11.93.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.93.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.93.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.93.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/HTTP_127.11.93.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.93.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/HTTP_127.11.93.148@KRBTEST.COM.keytab.
I20260809 02:20:10.205539 11638 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskWEWZ6r/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/postgres -l logfile start
2026-08-09 02:20:12.864 UTC [23098] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 02:20:12.864 UTC [23098] LOG: listening on IPv4 address "127.11.93.148", port 43405
2026-08-09 02:20:12.868 UTC [23098] LOG: listening on Unix socket "/tmp/.s.PGSQL.43405"
2026-08-09 02:20:12.903 UTC [23102] LOG: database system was shut down at 2026-08-09 02:20:11 UTC
2026-08-09 02:20:12.908 UTC [23098] LOG: database system is ready to accept connections
I20260809 02:20:13.887893 11638 mini_postgres.cc:96] Postgres bound to 43405
2026-08-09 02:20:13.895 UTC [23110] FATAL: database "slave" does not exist
127.11.93.148:43405 - accepting connections
I20260809 02:20:13.896297 11638 mini_ranger.cc:161] Starting Ranger...
I20260809 02:20:13.911849 11638 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 02:20:14.411962 11638 mini_ranger.cc:87] Created ranger Postgres database
I20260809 02:20:14.412034 11638 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ranger-admin
2026-08-09 02:20:14,761 [I] DB FLAVOR :POSTGRES
2026-08-09 02:20:14,761 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 02:20:14,762 [I] Checking connection..
2026-08-09 02:20:14,762 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:43405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 02:20:15,037 [I] Checking connection passed.
2026-08-09 02:20:15,037 [I] --------- Verifying version history table ---------
2026-08-09 02:20:15,037 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:43405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 02:20:15,283 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 02:20:15,283 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:43405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 02:20:15,547 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 02:20:15,548 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 02:20:15,548 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:43405/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 02:20:15.795 UTC [23180] WARNING: there is no transaction in progress
2026-08-09 02:20:15,802 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 02:20:15,802 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:43405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 02:20:16,053 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 02:20:16,054 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 02:20:16,054 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:43405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 02:20:16,292 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:43405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 02:20:16,558 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:43405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-w206.c.gcp-upstream.internal','N') ;"
2026-08-09 02:20:16,815 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:43405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 02:20:17,071 [I] Table x_portal_user does not exist in database ranger
2026-08-09 02:20:17,071 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:43405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 02:20:17,325 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 02:20:17,326 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:43405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 02:20:17,575 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:43405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 02:20:17,837 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 02:20:17,837 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:43405/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 02:20:18.806 UTC [23299] WARNING: there is no transaction in progress
2026-08-09 02:20:18.822 UTC [23299] WARNING: there is no transaction in progress
2026-08-09 02:20:18.839 UTC [23299] WARNING: there is no transaction in progress
2026-08-09 02:20:18.855 UTC [23299] WARNING: there is no transaction in progress
2026-08-09 02:20:18.874 UTC [23299] WARNING: there is no transaction in progress
2026-08-09 02:20:18.896 UTC [23299] WARNING: there is no transaction in progress
2026-08-09 02:20:18.963 UTC [23299] WARNING: there is no transaction in progress
2026-08-09 02:20:18.969 UTC [23299] WARNING: there is no transaction in progress
2026-08-09 02:20:18.984 UTC [23299] WARNING: there is no transaction in progress
2026-08-09 02:20:18.994 UTC [23299] WARNING: there is no transaction in progress
2026-08-09 02:20:19.004 UTC [23299] WARNING: there is no transaction in progress
2026-08-09 02:20:19.019 UTC [23299] WARNING: there is no transaction in progress
2026-08-09 02:20:19.028 UTC [23299] WARNING: there is no transaction in progress
2026-08-09 02:20:19.034 UTC [23299] WARNING: there is no transaction in progress
2026-08-09 02:20:19.042 UTC [23299] WARNING: there is no transaction in progress
2026-08-09 02:20:19.048 UTC [23299] WARNING: there is no transaction in progress
2026-08-09 02:20:19,712 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 02:20:19,713 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:43405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 02:20:19,940 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 02:20:19,940 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:43405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 02:20:20,209 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 02:20:20,210 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:43405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 02:20:20,472 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 02:20:20,472 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:43405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 02:20:20,732 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:43405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 02:20:20,985 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:43405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-w206.c.gcp-upstream.internal';"
2026-08-09 02:20:21,227 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 02:20:21,228 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:43405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 02:20:21,507 [I] DB_PATCHES have already been applied
I20260809 02:20:21.512984 11638 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ranger-admin:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskWEWZ6r/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 02:20:21.513054 11638 mini_ranger.cc:193] Using host: 127.11.93.148
I20260809 02:20:21.517069 11638 mini_ranger.cc:227] Ranger admin URL: http://127.11.93.148:38527
Aug 09, 2026 2:20:22 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 2:20:22 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 2:20:22 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 2:20:22 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 2:20:22 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 2:20:22 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 2:20:22 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 02:20:22.692441 11638 mini_ranger.cc:160] Time spent starting Ranger: real 8.796s user 0.002s sys 0.009s
Aug 09, 2026 2:20:44 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 2:20:44 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 09, 2026 2:20:44 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 2:20:44 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 2:20:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 2:20:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 2:20:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 2:20:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 2:20:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 2:20:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 2:20:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 2:20:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 2:20:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 2:20:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 2:20:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 2:20:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 2:20:44 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 2:20:45 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 02:20:45.710829 11638 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.93.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.93.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.93.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/rangerkms_127.11.93.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.93.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/rangerkms_127.11.93.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.93.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.93.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.93.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/HTTP_127.11.93.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.93.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/HTTP_127.11.93.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 02:20:45 dist-test-slave-w206 krb5kdc[23066](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242045, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 02:20:45.809175 11638 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 02:20:45.819365 11638 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 02:20:46.685300 11638 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 02:20:46.685375 11638 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ranger-kms
I20260809 02:20:46.685388 11638 mini_ranger_kms.cc:227] Using postgres at 127.11.93.148:43405
2026-08-09 02:20:46,925 [I] DB FLAVOR :POSTGRES
2026-08-09 02:20:46,925 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 02:20:46,925 [I] Checking connection
2026-08-09 02:20:46,925 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:43405/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 02:20:47,161 [I] connection success
2026-08-09 02:20:47,162 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 02:20:47,162 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 02:20:47,162 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:43405/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 02:20:47,397 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 02:20:47,397 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 02:20:47,397 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 02:20:47,398 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:43405/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 02:20:47,664 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 02:20:48.142306 11638 mini_ranger_kms.cc:310] Created kms service
I20260809 02:20:48.360659 11638 mini_ranger_kms.cc:326] Created kudu user
I20260809 02:20:48.409499 11638 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 02:20:48 dist-test-slave-w206 krb5kdc[23066](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242045, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.93.148@KRBTEST.COM
I20260809 02:20:48.864519 11638 mini_ranger_kms.cc:384] Added ranger policy
I20260809 02:20:48.864643 11638 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ranger-kms:/tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 02:20:48.864666 11638 mini_ranger_kms.cc:240] Using host: 127.11.93.148
I20260809 02:20:48.869390 11638 mini_ranger_kms.cc:276] Ranger KMS PID: 23491
I20260809 02:20:48.869529 11638 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.93.148:43347
Aug 09, 2026 2:20:49 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 2:20:49 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 2:20:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 2:20:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 2:20:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 2:20:50 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 02:20:51 dist-test-slave-w206 krb5kdc[23066](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786242051, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.93.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:51.258189 11638 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.449s user 0.005s sys 0.215s
I20260809 02:20:51.258296 11638 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 02:20:51.258373 11638 mini_ranger_kms.cc:401] 127.11.93.148:43347/kms/v1/keys
Aug 09 02:20:51 dist-test-slave-w206 krb5kdc[23066](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242051, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.93.148@KRBTEST.COM for HTTP/127.11.93.148@KRBTEST.COM
Aug 09 02:20:51 dist-test-slave-w206 krb5kdc[23066](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242051, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.93.148@KRBTEST.COM for HTTP/127.11.93.148@KRBTEST.COM
Aug 09 02:20:54 dist-test-slave-w206 krb5kdc[23066](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:20:54.306349 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:46459
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:43129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:46459
--ranger_config_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.93.148:43347/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:54.390048 23545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:54.390249 23545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:54.390272 23545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:54.391513 23545 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:20:54.391556 23545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:54.391569 23545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:54.391615 23545 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:20:54.391633 23545 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:20:54.393277 23545 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:43129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.93.148:43347/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:46459
--ranger_config_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:46459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:20:54.393529 23545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:54.393766 23545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:20:54.399080 23545 server_base.cc:1034] running on GCE node
W20260809 02:20:54.399089 23554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:54.399030 23550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:54.399039 23551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:54.399492 23545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:54.399806 23545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:54.400979 23545 hybrid_clock.cc:648] HybridClock initialized: now 1786242054400974 us; error 45 us; skew 500 ppm
Aug 09 02:20:54 dist-test-slave-w206 krb5kdc[23066](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242054, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:54.403455 23545 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:20:54.403888 23545 webserver.cc:460] Webserver started at http://127.11.93.190:36301/ using document root <none> and password file <none>
I20260809 02:20:54.404117 23545 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:54.404176 23545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:54.404335 23545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:20:54 dist-test-slave-w206 krb5kdc[23066](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242054, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for HTTP/127.11.93.148@KRBTEST.COM
I20260809 02:20:54.470778 23545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "96fb3bc89a4742f1a0529bb0a07b0f7e"
format_stamp: "Formatted at 2026-08-09 02:20:54 on dist-test-slave-w206"
server_key: "345a8ceccb19271d602d2f6fc6f35199"
server_key_iv: "59107f1b3a1ceead392d923b624c75db"
server_key_version: "kuduclusterkey@0"
I20260809 02:20:54.471253 23545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "96fb3bc89a4742f1a0529bb0a07b0f7e"
format_stamp: "Formatted at 2026-08-09 02:20:54 on dist-test-slave-w206"
server_key: "345a8ceccb19271d602d2f6fc6f35199"
server_key_iv: "59107f1b3a1ceead392d923b624c75db"
server_key_version: "kuduclusterkey@0"
I20260809 02:20:54.473135 23545 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260809 02:20:54.488945 23561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:54.489189 23545 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 02:20:54.489310 23545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "96fb3bc89a4742f1a0529bb0a07b0f7e"
format_stamp: "Formatted at 2026-08-09 02:20:54 on dist-test-slave-w206"
server_key: "345a8ceccb19271d602d2f6fc6f35199"
server_key_iv: "59107f1b3a1ceead392d923b624c75db"
server_key_version: "kuduclusterkey@0"
I20260809 02:20:54.489391 23545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:54.499585 23545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:54.501644 23545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:54.501820 23545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:54.507091 23545 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:46459
I20260809 02:20:54.507117 23617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:46459 every 8 connection(s)
I20260809 02:20:54.507530 23545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:20:54.508353 23618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:54.511605 23618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e: Bootstrap starting.
I20260809 02:20:54.512485 23618 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:54.512856 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 23545
I20260809 02:20:54.512879 23618 log.cc:824] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:54.512974 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:20:54.513208 11638 external_mini_cluster.cc:1428] Setting key 1e70a6c6e1330d374a070545ecd97bb3
I20260809 02:20:54.513787 23618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e: No bootstrap required, opened a new log
I20260809 02:20:54.517647 23618 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96fb3bc89a4742f1a0529bb0a07b0f7e" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46459 } }
I20260809 02:20:54.517838 23618 raft_consensus.cc:374] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:54.517874 23618 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96fb3bc89a4742f1a0529bb0a07b0f7e, State: Initialized, Role: FOLLOWER
I20260809 02:20:54.518042 23618 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96fb3bc89a4742f1a0529bb0a07b0f7e" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46459 } }
I20260809 02:20:54.518138 23618 raft_consensus.cc:388] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:20:54.518209 23618 raft_consensus.cc:482] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:20:54.518276 23618 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:54.519073 23618 raft_consensus.cc:504] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96fb3bc89a4742f1a0529bb0a07b0f7e" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46459 } }
I20260809 02:20:54.519272 23618 leader_election.cc:302] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 96fb3bc89a4742f1a0529bb0a07b0f7e; no voters:
I20260809 02:20:54.519495 23618 leader_election.cc:288] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:20:54.519559 23623 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:20:54.519847 23623 raft_consensus.cc:686] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e [term 1 LEADER]: Becoming Leader. State: Replica: 96fb3bc89a4742f1a0529bb0a07b0f7e, State: Running, Role: LEADER
I20260809 02:20:54.520037 23618 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:20:54.520018 23623 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96fb3bc89a4742f1a0529bb0a07b0f7e" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46459 } }
I20260809 02:20:54.520455 23623 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "96fb3bc89a4742f1a0529bb0a07b0f7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96fb3bc89a4742f1a0529bb0a07b0f7e" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46459 } } }
I20260809 02:20:54.520526 23623 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e [sys.catalog]: This master's current role is: LEADER
I20260809 02:20:54.520686 23623 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96fb3bc89a4742f1a0529bb0a07b0f7e. Latest consensus state: current_term: 1 leader_uuid: "96fb3bc89a4742f1a0529bb0a07b0f7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96fb3bc89a4742f1a0529bb0a07b0f7e" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46459 } } }
I20260809 02:20:54.520735 23623 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e [sys.catalog]: This master's current role is: LEADER
I20260809 02:20:54.521003 23628 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:20:54.521579 23628 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 02:20:54 dist-test-slave-w206 krb5kdc[23066](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:20:54.522121 23618 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 02:20:54.530964 23622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:54.513788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54062 (local address 127.11.93.190:46459)
0809 02:20:54.513956 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:54.513965 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:54.514000 (+ 35us) server_negotiation.cc:407] Connection header received
0809 02:20:54.515684 (+ 1684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:54.515699 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:54.515760 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:54.515933 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:54.516625 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:54.517500 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:54.518569 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:54.519224 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:54.519421 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:54.522602 (+ 3181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:54.522606 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:54.522607 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:54.522620 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:54.527952 (+ 5332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:54.528570 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:54.528575 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:54.528576 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:54.528770 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:54.529044 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:54.529045 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:54.529045 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:54.529590 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:54.530260 (+ 670us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:54.530350 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 02:20:54.530652 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":69,"threads_started":1}
I20260809 02:20:54.535092 23639 mvcc.cc:205] Tried to move back new op lower bound from 7316447455338184704 to 7316447455314755584. Current Snapshot: MvccSnapshot[applied={T|T < 7316447455338184704}]
I20260809 02:20:54.536114 23628 catalog_manager.cc:1347] Generated new cluster ID: 91f0cda6dfba408b99c061920510e331
I20260809 02:20:54.536161 23628 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:20:54.543104 23628 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:20:54.543936 23628 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:20:54.550104 23628 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e: Generated new TSK 0
I20260809 02:20:54.550407 23628 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.93.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
I20260809 02:20:55.306421 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.93.148:43347/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:46459
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:43129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:55.406736 23667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:55.407043 23667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:55.407084 23667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:55.408766 23667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:55.408844 23667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:55.408891 23667 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:20:55.410486 23667 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:43129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.93.148:43347/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:46459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23667
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:20:55.410764 23667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:55.411065 23667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:55.417517 23673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:55.417547 23676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:55.417989 23674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:55.418478 23667 server_base.cc:1034] running on GCE node
I20260809 02:20:55.418720 23667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:55.419037 23667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:55.420221 23667 hybrid_clock.cc:648] HybridClock initialized: now 1786242055420196 us; error 40 us; skew 500 ppm
Aug 09 02:20:55 dist-test-slave-w206 krb5kdc[23066](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242055, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:55.423622 23667 init.cc:377] Logged in from keytab as kudu/127.11.93.129@KRBTEST.COM (short username kudu)
I20260809 02:20:55.424136 23667 webserver.cc:460] Webserver started at http://127.11.93.129:46223/ using document root <none> and password file <none>
I20260809 02:20:55.424376 23667 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:55.424474 23667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:55.424639 23667 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:20:55 dist-test-slave-w206 krb5kdc[23066](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242055, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for HTTP/127.11.93.148@KRBTEST.COM
I20260809 02:20:55.439707 23667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "431b0793a99a4f9580ef7db0f84a656b"
format_stamp: "Formatted at 2026-08-09 02:20:55 on dist-test-slave-w206"
server_key: "cceb631d718f20b6352860476e99d7ea"
server_key_iv: "323e0d323718adbe6e93fb89ee956dc5"
server_key_version: "kuduclusterkey@0"
I20260809 02:20:55.440155 23667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "431b0793a99a4f9580ef7db0f84a656b"
format_stamp: "Formatted at 2026-08-09 02:20:55 on dist-test-slave-w206"
server_key: "cceb631d718f20b6352860476e99d7ea"
server_key_iv: "323e0d323718adbe6e93fb89ee956dc5"
server_key_version: "kuduclusterkey@0"
I20260809 02:20:55.441887 23667 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:20:55.454833 23685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:55.455066 23667 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:20:55.455164 23667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "431b0793a99a4f9580ef7db0f84a656b"
format_stamp: "Formatted at 2026-08-09 02:20:55 on dist-test-slave-w206"
server_key: "cceb631d718f20b6352860476e99d7ea"
server_key_iv: "323e0d323718adbe6e93fb89ee956dc5"
server_key_version: "kuduclusterkey@0"
I20260809 02:20:55.455281 23667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:55.474085 23667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:55.476657 23667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:55.476866 23667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:55.477226 23667 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:20:55.477694 23667 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:55.477756 23667 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:55.477828 23667 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:55.477873 23667 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:55.484642 23667 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:45555
I20260809 02:20:55.485165 23667 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:20:55.487258 23801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:45555 every 8 connection(s)
I20260809 02:20:55.495193 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 23667
I20260809 02:20:55.495313 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:20:55.495530 11638 external_mini_cluster.cc:1428] Setting key e6c149375ba50a9c1f024a6d44b3fdc0
Aug 09 02:20:55 dist-test-slave-w206 krb5kdc[23066](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242055, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:20:55.504554 23805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:55.491751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:60643 (local address 127.11.93.190:46459)
0809 02:20:55.492953 (+ 1202us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:55.492955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:55.492964 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:20:55.492992 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:55.492992 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:55.493006 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:55.493071 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:55.493870 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:55.494713 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:55.496172 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:55.496471 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:55.496537 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:55.500562 (+ 4025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:55.500563 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:55.500564 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:55.500572 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:55.502585 (+ 2013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:55.503193 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:55.503194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:55.503195 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:55.503277 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:55.503732 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:55.503733 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:55.503734 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:55.503886 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:55.503958 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:55.504354 (+ 396us) server_negotiation.cc:299] Negotiation successful
0809 02:20:55.504456 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1169,"thread_start_us":108,"threads_started":1}
I20260809 02:20:55.504731 23804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:55.491700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:46459 (local address 127.11.93.129:60643)
0809 02:20:55.492070 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:55.492115 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:55.492742 (+ 627us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:55.493207 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:55.493212 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:55.493477 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:55.493758 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:55.493764 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:55.494822 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:55.494823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:55.496086 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:55.496089 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:55.496605 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:55.496607 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:55.496749 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:55.498564 (+ 1815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:55.498575 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:55.500438 (+ 1863us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:55.502682 (+ 2244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:55.502690 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:55.502692 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:55.503097 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:55.503482 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:55.503484 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:55.503484 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:55.503642 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:55.503998 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:55.504006 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:55.504179 (+ 173us) client_negotiation.cc:769] Sending connection context
0809 02:20:55.504318 (+ 139us) client_negotiation.cc:240] Negotiation successful
0809 02:20:55.504474 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":98,"threads_started":1}
I20260809 02:20:55.505317 23802 heartbeater.cc:347] Connected to a master server at 127.11.93.190:46459
I20260809 02:20:55.505436 23802 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:55.505643 23802 heartbeater.cc:511] Master 127.11.93.190:46459 requested a full tablet report, sending...
I20260809 02:20:55.506237 23580 ts_manager.cc:194] Registered new tserver with Master: 431b0793a99a4f9580ef7db0f84a656b (127.11.93.129:45555)
I20260809 02:20:55.507297 23580 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:60643
WARNING: no policy specified for kudu/127.11.93.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
I20260809 02:20:55.540174 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.93.148:43347/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:46459
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:43129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:20:55 dist-test-slave-w206 krb5kdc[23066](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786242055, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 02:20:55.678417 23810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:55.678794 23810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:55.678874 23810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:55.680573 23810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:55.680671 23810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:55.680765 23810 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:20:55.682935 23810 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:43129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.93.148:43347/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:46459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23810
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:20:55.683491 23810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:55.683796 23810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:55.690436 23819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:55.690830 23821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:55.691512 23818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:55.692095 23810 server_base.cc:1034] running on GCE node
I20260809 02:20:55.692317 23810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:55.692574 23810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:55.699927 23810 hybrid_clock.cc:648] HybridClock initialized: now 1786242055699891 us; error 39 us; skew 500 ppm
Aug 09 02:20:55 dist-test-slave-w206 krb5kdc[23066](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242055, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:55.703553 23810 init.cc:377] Logged in from keytab as kudu/127.11.93.130@KRBTEST.COM (short username kudu)
I20260809 02:20:55.704169 23810 webserver.cc:460] Webserver started at http://127.11.93.130:38309/ using document root <none> and password file <none>
I20260809 02:20:55.704530 23810 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:55.704663 23810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:55.704872 23810 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:20:55 dist-test-slave-w206 krb5kdc[23066](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242055, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for HTTP/127.11.93.148@KRBTEST.COM
I20260809 02:20:55.720340 23810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "fce73fce9f754fb3ac38335434ac9137"
format_stamp: "Formatted at 2026-08-09 02:20:55 on dist-test-slave-w206"
server_key: "0955542cd99e6e0222e7b499d7d7a6b0"
server_key_iv: "a6c8ee11f3e6fec55148473de14c76e9"
server_key_version: "kuduclusterkey@0"
I20260809 02:20:55.720816 23810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "fce73fce9f754fb3ac38335434ac9137"
format_stamp: "Formatted at 2026-08-09 02:20:55 on dist-test-slave-w206"
server_key: "0955542cd99e6e0222e7b499d7d7a6b0"
server_key_iv: "a6c8ee11f3e6fec55148473de14c76e9"
server_key_version: "kuduclusterkey@0"
I20260809 02:20:55.723616 23810 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20260809 02:20:55.739178 23829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:55.739385 23810 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:20:55.739492 23810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "fce73fce9f754fb3ac38335434ac9137"
format_stamp: "Formatted at 2026-08-09 02:20:55 on dist-test-slave-w206"
server_key: "0955542cd99e6e0222e7b499d7d7a6b0"
server_key_iv: "a6c8ee11f3e6fec55148473de14c76e9"
server_key_version: "kuduclusterkey@0"
I20260809 02:20:55.739609 23810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:55.752374 23810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:55.754944 23810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:55.755203 23810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:55.755496 23810 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:20:55.755918 23810 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:55.756013 23810 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:55.756088 23810 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:55.756146 23810 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:55.762880 23810 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:43607
I20260809 02:20:55.763458 23810 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:20:55.766390 23949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:43607 every 8 connection(s)
I20260809 02:20:55.769632 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 23810
I20260809 02:20:55.769743 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:20:55.769942 11638 external_mini_cluster.cc:1428] Setting key 237f7e06f3b4442808cd9eb3fdfd8c9a
Aug 09 02:20:55 dist-test-slave-w206 krb5kdc[23066](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242055, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:20:55.780783 23805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:55.767103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:59069 (local address 127.11.93.190:46459)
0809 02:20:55.767151 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:55.767154 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:55.767796 (+ 642us) server_negotiation.cc:407] Connection header received
0809 02:20:55.768503 (+ 707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:55.768505 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:55.768524 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:55.768558 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:55.769415 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:55.770195 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:55.774202 (+ 4007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:55.774562 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:55.774608 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:55.777308 (+ 2700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:55.777310 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:55.777310 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:55.777318 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:55.779101 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:55.779617 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:55.779618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:55.779618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:55.779681 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:55.780008 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:55.780009 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:55.780010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:55.780156 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:55.780199 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:55.780588 (+ 389us) server_negotiation.cc:299] Negotiation successful
0809 02:20:55.780683 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 02:20:55.781569 23953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:55.767258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:46459 (local address 127.11.93.130:59069)
0809 02:20:55.767665 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:55.767709 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:55.768371 (+ 662us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:55.768744 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:55.768748 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:55.768999 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:55.769274 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:55.769279 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:55.772809 (+ 3530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:55.772810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:55.774091 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:55.774094 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:55.774704 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:55.774705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:55.774858 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:55.775486 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:55.775497 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:55.777191 (+ 1694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:55.779199 (+ 2008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:55.779206 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:55.779208 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:55.779522 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:55.779755 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:55.779755 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:55.779756 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:55.779900 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:55.780246 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:55.780252 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:55.780427 (+ 175us) client_negotiation.cc:769] Sending connection context
0809 02:20:55.781146 (+ 719us) client_negotiation.cc:240] Negotiation successful
0809 02:20:55.781315 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":107,"threads_started":1}
I20260809 02:20:55.782248 23950 heartbeater.cc:347] Connected to a master server at 127.11.93.190:46459
I20260809 02:20:55.782357 23950 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:55.782568 23950 heartbeater.cc:511] Master 127.11.93.190:46459 requested a full tablet report, sending...
I20260809 02:20:55.782922 23580 ts_manager.cc:194] Registered new tserver with Master: fce73fce9f754fb3ac38335434ac9137 (127.11.93.130:43607)
I20260809 02:20:55.783428 23580 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:59069
WARNING: no policy specified for kudu/127.11.93.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
I20260809 02:20:55.816455 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.93.148:43347/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:46459
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:43129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:20:55.948089 23957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:20:55.948385 23957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:20:55.948426 23957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:20:55.950166 23957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:20:55.950299 23957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:20:55.950398 23957 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:20:55.952728 23957 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:43129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.93.148:43347/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:46459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23957
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:20:55.952994 23957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:20:55.953315 23957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:20:55.960069 23962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:55.960196 23965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:20:55.960074 23963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:20:55.964241 23957 server_base.cc:1034] running on GCE node
I20260809 02:20:55.964449 23957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:20:55.964715 23957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:20:55.967983 23957 hybrid_clock.cc:648] HybridClock initialized: now 1786242055967951 us; error 44 us; skew 500 ppm
Aug 09 02:20:55 dist-test-slave-w206 krb5kdc[23066](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242055, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:20:55.970839 23957 init.cc:377] Logged in from keytab as kudu/127.11.93.131@KRBTEST.COM (short username kudu)
I20260809 02:20:55.971424 23957 webserver.cc:460] Webserver started at http://127.11.93.131:35715/ using document root <none> and password file <none>
I20260809 02:20:55.971670 23957 fs_manager.cc:359] Metadata directory not provided
I20260809 02:20:55.971751 23957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:20:55.971925 23957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:20:55 dist-test-slave-w206 krb5kdc[23066](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242055, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for HTTP/127.11.93.148@KRBTEST.COM
I20260809 02:20:55.984977 23957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "88ed284d66f745a7b26172252ef135db"
format_stamp: "Formatted at 2026-08-09 02:20:55 on dist-test-slave-w206"
server_key: "c45e6f9ab83ef03ec18314db9ae15c27"
server_key_iv: "6fbd2a33989357e0e799849edf85ca76"
server_key_version: "kuduclusterkey@0"
I20260809 02:20:55.985394 23957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "88ed284d66f745a7b26172252ef135db"
format_stamp: "Formatted at 2026-08-09 02:20:55 on dist-test-slave-w206"
server_key: "c45e6f9ab83ef03ec18314db9ae15c27"
server_key_iv: "6fbd2a33989357e0e799849edf85ca76"
server_key_version: "kuduclusterkey@0"
I20260809 02:20:55.986986 23957 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 02:20:56.012904 23972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:56.013283 23957 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260809 02:20:56.013406 23957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "88ed284d66f745a7b26172252ef135db"
format_stamp: "Formatted at 2026-08-09 02:20:55 on dist-test-slave-w206"
server_key: "c45e6f9ab83ef03ec18314db9ae15c27"
server_key_iv: "6fbd2a33989357e0e799849edf85ca76"
server_key_version: "kuduclusterkey@0"
I20260809 02:20:56.013507 23957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:20:56.039958 23957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:20:56.045894 23957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:20:56.046103 23957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:20:56.046381 23957 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:20:56.046806 23957 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:20:56.046861 23957 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:56.046896 23957 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:20:56.046965 23957 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:20:56.057861 23957 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:46003
I20260809 02:20:56.058419 23957 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:20:56.059540 24091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:46003 every 8 connection(s)
I20260809 02:20:56.065435 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 23957
I20260809 02:20:56.065553 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:20:56.065785 11638 external_mini_cluster.cc:1428] Setting key ee7445b09214da14eba93ef1b0cb760d
Aug 09 02:20:56 dist-test-slave-w206 krb5kdc[23066](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242055, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:20:56.071983 23805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:56.059823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:47275 (local address 127.11.93.190:46459)
0809 02:20:56.059887 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:56.059889 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:56.060243 (+ 354us) server_negotiation.cc:407] Connection header received
0809 02:20:56.060975 (+ 732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:56.060976 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:56.060990 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:56.061064 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:56.061841 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.062584 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.064186 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.064508 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.064594 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:56.068120 (+ 3526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:56.068121 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:56.068122 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:56.068130 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:56.070051 (+ 1921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:56.070567 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:56.070568 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:56.070569 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:56.070633 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:56.070946 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:56.070947 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:56.070947 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:56.071188 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:56.071285 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:56.071790 (+ 505us) server_negotiation.cc:299] Negotiation successful
0809 02:20:56.071883 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 02:20:56.072714 24094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:56.059516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:46459 (local address 127.11.93.131:47275)
0809 02:20:56.060099 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:56.060148 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:56.060851 (+ 703us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:56.061155 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:56.061159 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:56.061422 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:20:56.061705 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:56.061711 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.062703 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.062704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:56.064075 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:56.064078 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.064615 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.064617 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:56.064775 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:56.066087 (+ 1312us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:20:56.066097 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:20:56.067998 (+ 1901us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:20:56.070144 (+ 2146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:56.070152 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:56.070154 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:56.070481 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:56.070714 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:20:56.070715 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:20:56.070716 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:20:56.070866 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:20:56.071315 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:20:56.071323 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:20:56.071602 (+ 279us) client_negotiation.cc:769] Sending connection context
0809 02:20:56.072306 (+ 704us) client_negotiation.cc:240] Negotiation successful
0809 02:20:56.072480 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":83,"threads_started":1}
I20260809 02:20:56.073267 24092 heartbeater.cc:347] Connected to a master server at 127.11.93.190:46459
I20260809 02:20:56.073364 24092 heartbeater.cc:464] Registering TS with master...
I20260809 02:20:56.073557 24092 heartbeater.cc:511] Master 127.11.93.190:46459 requested a full tablet report, sending...
I20260809 02:20:56.073956 23580 ts_manager.cc:194] Registered new tserver with Master: 88ed284d66f745a7b26172252ef135db (127.11.93.131:46003)
I20260809 02:20:56.074414 23580 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:47275
I20260809 02:20:56.077577 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:20:56.086823 23805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:56.079661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36212 (local address 127.11.93.190:46459)
0809 02:20:56.079712 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:56.079714 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:56.079899 (+ 185us) server_negotiation.cc:407] Connection header received
0809 02:20:56.079995 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:56.079996 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:56.080008 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:56.080052 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:20:56.080747 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.081243 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.081972 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.082177 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.082260 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:56.083918 (+ 1658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:20:56.083920 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:20:56.083920 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:20:56.083927 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:20:56.085533 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:56.085929 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:56.085930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:56.085930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:56.085988 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:20:56.086193 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:20:56.086194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:20:56.086194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:20:56.086313 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:20:56.086423 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:56.086628 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 02:20:56.086706 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 02:20:56.088560 23580 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36212:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:20:56.091006 23580 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:20:56.100881 24107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:56.094500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:43607 (local address 127.0.0.1:38078)
0809 02:20:56.095548 (+ 1048us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:56.095579 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:56.095633 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:56.095907 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:56.095910 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:56.095912 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:56.095986 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:56.095988 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.097847 (+ 1859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.097848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:56.099167 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:56.099170 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.100587 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.100588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:56.100673 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:56.100686 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 02:20:56.100749 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 02:20:56.100801 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1020,"thread_start_us":92,"threads_started":1}
I20260809 02:20:56.103084 24108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:56.095195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38078 (local address 127.11.93.130:43607)
0809 02:20:56.095746 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:56.095749 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:56.095757 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:20:56.095797 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:56.095799 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:56.095811 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:56.095904 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:56.096081 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.097751 (+ 1670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.099298 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.100404 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.100474 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:56.100556 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:56.102899 (+ 2343us) server_negotiation.cc:299] Negotiation successful
0809 02:20:56.102943 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":520,"thread_start_us":97,"threads_started":1}
I20260809 02:20:56.103971 23880 tablet_service.cc:1467] Processing CreateTablet for tablet 23f477a03e25480895629bdccfa3c147 (DEFAULT_TABLE table=test-table [id=cc45ab1ca87c412b97efe8276188ecf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:56.104365 23880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23f477a03e25480895629bdccfa3c147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:56.107264 24104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:56.094746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:45555 (local address 127.0.0.1:56430)
0809 02:20:56.096207 (+ 1461us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:56.096215 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:56.096254 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:56.096484 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:56.096484 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:56.096486 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:56.096525 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:56.096526 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.101831 (+ 5305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.101832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:56.105673 (+ 3841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:56.105676 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.107012 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.107014 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:56.107081 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:56.107086 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:20:56.107136 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 02:20:56.107177 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1449,"thread_start_us":143,"threads_started":1}
I20260809 02:20:56.107543 24109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:56.095393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56430 (local address 127.11.93.129:45555)
0809 02:20:56.096015 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:56.096019 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:56.096307 (+ 288us) server_negotiation.cc:407] Connection header received
0809 02:20:56.096342 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:56.096344 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:56.096359 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:56.096427 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:56.096589 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.100468 (+ 3879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.106015 (+ 5547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.106817 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.106891 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:56.106951 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:56.107426 (+ 475us) server_negotiation.cc:299] Negotiation successful
0809 02:20:56.107469 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":590,"thread_start_us":51,"threads_started":1}
I20260809 02:20:56.108285 23715 tablet_service.cc:1467] Processing CreateTablet for tablet 23f477a03e25480895629bdccfa3c147 (DEFAULT_TABLE table=test-table [id=cc45ab1ca87c412b97efe8276188ecf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:56.108637 23715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23f477a03e25480895629bdccfa3c147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:56.109824 24110 tablet_bootstrap.cc:492] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137: Bootstrap starting.
I20260809 02:20:56.110857 24110 tablet_bootstrap.cc:654] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:56.111548 24110 log.cc:824] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:56.112406 24110 tablet_bootstrap.cc:492] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137: No bootstrap required, opened a new log
I20260809 02:20:56.112478 24110 ts_tablet_manager.cc:1397] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260809 02:20:56.113499 24105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:56.094502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:46003 (local address 127.0.0.1:50932)
0809 02:20:56.096077 (+ 1575us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:56.096088 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:56.096136 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:56.100556 (+ 4420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:56.100557 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:56.100559 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:56.100600 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:56.100601 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.103553 (+ 2952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.103554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:56.104611 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:56.104614 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.113236 (+ 8622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.113238 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:56.113309 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:56.113314 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:20:56.113368 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 02:20:56.113421 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1558,"mutex_wait_us":4,"thread_start_us":93,"threads_started":1}
I20260809 02:20:56.113744 24112 tablet_bootstrap.cc:492] T 23f477a03e25480895629bdccfa3c147 P 431b0793a99a4f9580ef7db0f84a656b: Bootstrap starting.
I20260809 02:20:56.114486 24112 tablet_bootstrap.cc:654] T 23f477a03e25480895629bdccfa3c147 P 431b0793a99a4f9580ef7db0f84a656b: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:56.114614 24110 raft_consensus.cc:348] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce73fce9f754fb3ac38335434ac9137" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 43607 } } peers { permanent_uuid: "88ed284d66f745a7b26172252ef135db" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 46003 } } peers { permanent_uuid: "431b0793a99a4f9580ef7db0f84a656b" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 45555 } }
I20260809 02:20:56.114782 24110 raft_consensus.cc:374] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:56.114817 24110 raft_consensus.cc:729] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fce73fce9f754fb3ac38335434ac9137, State: Initialized, Role: FOLLOWER
I20260809 02:20:56.114826 24112 log.cc:824] T 23f477a03e25480895629bdccfa3c147 P 431b0793a99a4f9580ef7db0f84a656b: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:56.115382 24106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:56.094782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50932 (local address 127.11.93.131:46003)
0809 02:20:56.095427 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:56.095432 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:56.097344 (+ 1912us) server_negotiation.cc:407] Connection header received
0809 02:20:56.097391 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:56.097393 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:56.097409 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:56.097483 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:56.101195 (+ 3712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.102651 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.108783 (+ 6132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.109524 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.109598 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:56.109672 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:56.115170 (+ 5498us) server_negotiation.cc:299] Negotiation successful
0809 02:20:56.115231 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":99,"threads_started":1}
I20260809 02:20:56.115609 24112 tablet_bootstrap.cc:492] T 23f477a03e25480895629bdccfa3c147 P 431b0793a99a4f9580ef7db0f84a656b: No bootstrap required, opened a new log
I20260809 02:20:56.115661 24112 ts_tablet_manager.cc:1397] T 23f477a03e25480895629bdccfa3c147 P 431b0793a99a4f9580ef7db0f84a656b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:20:56.116394 24022 tablet_service.cc:1467] Processing CreateTablet for tablet 23f477a03e25480895629bdccfa3c147 (DEFAULT_TABLE table=test-table [id=cc45ab1ca87c412b97efe8276188ecf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:20:56.116739 24022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23f477a03e25480895629bdccfa3c147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:20:56.118309 24112 raft_consensus.cc:348] T 23f477a03e25480895629bdccfa3c147 P 431b0793a99a4f9580ef7db0f84a656b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce73fce9f754fb3ac38335434ac9137" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 43607 } } peers { permanent_uuid: "88ed284d66f745a7b26172252ef135db" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 46003 } } peers { permanent_uuid: "431b0793a99a4f9580ef7db0f84a656b" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 45555 } }
I20260809 02:20:56.118474 24112 raft_consensus.cc:374] T 23f477a03e25480895629bdccfa3c147 P 431b0793a99a4f9580ef7db0f84a656b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:56.118518 24112 raft_consensus.cc:729] T 23f477a03e25480895629bdccfa3c147 P 431b0793a99a4f9580ef7db0f84a656b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 431b0793a99a4f9580ef7db0f84a656b, State: Initialized, Role: FOLLOWER
I20260809 02:20:56.118654 24112 consensus_queue.cc:260] T 23f477a03e25480895629bdccfa3c147 P 431b0793a99a4f9580ef7db0f84a656b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce73fce9f754fb3ac38335434ac9137" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 43607 } } peers { permanent_uuid: "88ed284d66f745a7b26172252ef135db" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 46003 } } peers { permanent_uuid: "431b0793a99a4f9580ef7db0f84a656b" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 45555 } }
I20260809 02:20:56.118924 24112 ts_tablet_manager.cc:1428] T 23f477a03e25480895629bdccfa3c147 P 431b0793a99a4f9580ef7db0f84a656b: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260809 02:20:56.119058 23802 heartbeater.cc:503] Master 127.11.93.190:46459 was elected leader, sending a full tablet report...
I20260809 02:20:56.114934 24110 consensus_queue.cc:260] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce73fce9f754fb3ac38335434ac9137" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 43607 } } peers { permanent_uuid: "88ed284d66f745a7b26172252ef135db" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 46003 } } peers { permanent_uuid: "431b0793a99a4f9580ef7db0f84a656b" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 45555 } }
I20260809 02:20:56.120390 23950 heartbeater.cc:503] Master 127.11.93.190:46459 was elected leader, sending a full tablet report...
I20260809 02:20:56.121479 24110 ts_tablet_manager.cc:1428] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260809 02:20:56.122069 24116 tablet_bootstrap.cc:492] T 23f477a03e25480895629bdccfa3c147 P 88ed284d66f745a7b26172252ef135db: Bootstrap starting.
I20260809 02:20:56.122871 24116 tablet_bootstrap.cc:654] T 23f477a03e25480895629bdccfa3c147 P 88ed284d66f745a7b26172252ef135db: Neither blocks nor log segments found. Creating new log.
I20260809 02:20:56.123205 24116 log.cc:824] T 23f477a03e25480895629bdccfa3c147 P 88ed284d66f745a7b26172252ef135db: Log is configured to *not* fsync() on all Append() calls
I20260809 02:20:56.123903 24116 tablet_bootstrap.cc:492] T 23f477a03e25480895629bdccfa3c147 P 88ed284d66f745a7b26172252ef135db: No bootstrap required, opened a new log
I20260809 02:20:56.123983 24116 ts_tablet_manager.cc:1397] T 23f477a03e25480895629bdccfa3c147 P 88ed284d66f745a7b26172252ef135db: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:20:56.125741 24116 raft_consensus.cc:348] T 23f477a03e25480895629bdccfa3c147 P 88ed284d66f745a7b26172252ef135db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce73fce9f754fb3ac38335434ac9137" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 43607 } } peers { permanent_uuid: "88ed284d66f745a7b26172252ef135db" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 46003 } } peers { permanent_uuid: "431b0793a99a4f9580ef7db0f84a656b" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 45555 } }
I20260809 02:20:56.126336 24116 raft_consensus.cc:374] T 23f477a03e25480895629bdccfa3c147 P 88ed284d66f745a7b26172252ef135db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:20:56.126441 24116 raft_consensus.cc:729] T 23f477a03e25480895629bdccfa3c147 P 88ed284d66f745a7b26172252ef135db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed284d66f745a7b26172252ef135db, State: Initialized, Role: FOLLOWER
I20260809 02:20:56.126633 24116 consensus_queue.cc:260] T 23f477a03e25480895629bdccfa3c147 P 88ed284d66f745a7b26172252ef135db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce73fce9f754fb3ac38335434ac9137" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 43607 } } peers { permanent_uuid: "88ed284d66f745a7b26172252ef135db" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 46003 } } peers { permanent_uuid: "431b0793a99a4f9580ef7db0f84a656b" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 45555 } }
I20260809 02:20:56.126947 24116 ts_tablet_manager.cc:1428] T 23f477a03e25480895629bdccfa3c147 P 88ed284d66f745a7b26172252ef135db: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 02:20:56.127125 24092 heartbeater.cc:503] Master 127.11.93.190:46459 was elected leader, sending a full tablet report...
Aug 09 02:20:56 dist-test-slave-w206 krb5kdc[23066](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242055, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for HTTP/127.11.93.148@KRBTEST.COM
W20260809 02:20:56.242506 23803 tablet.cc:2369] T 23f477a03e25480895629bdccfa3c147 P 431b0793a99a4f9580ef7db0f84a656b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:20:56.267990 23951 tablet.cc:2369] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:20:56.310376 24093 tablet.cc:2369] T 23f477a03e25480895629bdccfa3c147 P 88ed284d66f745a7b26172252ef135db: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:20:56.378491 24115 raft_consensus.cc:482] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:20:56.378633 24115 raft_consensus.cc:504] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce73fce9f754fb3ac38335434ac9137" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 43607 } } peers { permanent_uuid: "88ed284d66f745a7b26172252ef135db" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 46003 } } peers { permanent_uuid: "431b0793a99a4f9580ef7db0f84a656b" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 45555 } }
I20260809 02:20:56.379145 24115 leader_election.cc:288] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed284d66f745a7b26172252ef135db (127.11.93.131:46003), 431b0793a99a4f9580ef7db0f84a656b (127.11.93.129:45555)
I20260809 02:20:56.383519 24106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:56.379517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:43379 (local address 127.11.93.131:46003)
0809 02:20:56.379567 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:56.379569 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:56.380129 (+ 560us) server_negotiation.cc:407] Connection header received
0809 02:20:56.380227 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:56.380228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:56.380239 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:56.380267 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:56.380475 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.381129 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.382527 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.383100 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.383152 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:56.383162 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:56.383414 (+ 252us) server_negotiation.cc:299] Negotiation successful
0809 02:20:56.383455 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 02:20:56.383519 24109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:56.379532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:54099 (local address 127.11.93.129:45555)
0809 02:20:56.379584 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:56.379586 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:56.379694 (+ 108us) server_negotiation.cc:407] Connection header received
0809 02:20:56.379817 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:56.379818 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:56.379829 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:56.379861 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:20:56.380150 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.380906 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.382527 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.383124 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.383161 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:56.383168 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:56.383402 (+ 234us) server_negotiation.cc:299] Negotiation successful
0809 02:20:56.383443 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 02:20:56.383797 24121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:56.379329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:45555 (local address 127.11.93.130:54099)
0809 02:20:56.379633 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:56.379646 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:56.379725 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:56.379956 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:56.379958 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:56.379960 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:56.380043 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:56.380045 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.380998 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.380999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:56.382426 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:56.382428 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.383228 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.383229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:56.383304 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:56.383309 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:20:56.383641 (+ 332us) client_negotiation.cc:240] Negotiation successful
0809 02:20:56.383695 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":292,"thread_start_us":69,"threads_started":1}
I20260809 02:20:56.384101 24120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:56.379336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:46003 (local address 127.11.93.130:43379)
0809 02:20:56.380069 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:56.380079 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:20:56.380154 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:20:56.380339 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:20:56.380340 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:20:56.380341 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:20:56.380406 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:56.380407 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.381228 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.381228 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:56.382396 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:20:56.382400 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.383226 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.383227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:20:56.383324 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:56.383327 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:20:56.383964 (+ 637us) client_negotiation.cc:240] Negotiation successful
0809 02:20:56.384007 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":718,"thread_start_us":70,"threads_started":1}
I20260809 02:20:56.384164 23754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23f477a03e25480895629bdccfa3c147" candidate_uuid: "fce73fce9f754fb3ac38335434ac9137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "431b0793a99a4f9580ef7db0f84a656b" is_pre_election: true
I20260809 02:20:56.384334 23754 raft_consensus.cc:2454] T 23f477a03e25480895629bdccfa3c147 P 431b0793a99a4f9580ef7db0f84a656b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fce73fce9f754fb3ac38335434ac9137 in term 0.
I20260809 02:20:56.384585 23831 leader_election.cc:302] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 431b0793a99a4f9580ef7db0f84a656b, fce73fce9f754fb3ac38335434ac9137; no voters:
I20260809 02:20:56.384584 24029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23f477a03e25480895629bdccfa3c147" candidate_uuid: "fce73fce9f754fb3ac38335434ac9137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed284d66f745a7b26172252ef135db" is_pre_election: true
I20260809 02:20:56.384716 24115 raft_consensus.cc:2781] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:20:56.384759 24115 raft_consensus.cc:482] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:20:56.384768 24029 raft_consensus.cc:2454] T 23f477a03e25480895629bdccfa3c147 P 88ed284d66f745a7b26172252ef135db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fce73fce9f754fb3ac38335434ac9137 in term 0.
I20260809 02:20:56.384796 24115 raft_consensus.cc:3037] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:56.385725 24115 raft_consensus.cc:504] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce73fce9f754fb3ac38335434ac9137" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 43607 } } peers { permanent_uuid: "88ed284d66f745a7b26172252ef135db" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 46003 } } peers { permanent_uuid: "431b0793a99a4f9580ef7db0f84a656b" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 45555 } }
I20260809 02:20:56.385861 24115 leader_election.cc:288] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed284d66f745a7b26172252ef135db (127.11.93.131:46003), 431b0793a99a4f9580ef7db0f84a656b (127.11.93.129:45555)
I20260809 02:20:56.386257 23754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23f477a03e25480895629bdccfa3c147" candidate_uuid: "fce73fce9f754fb3ac38335434ac9137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "431b0793a99a4f9580ef7db0f84a656b"
I20260809 02:20:56.386332 23754 raft_consensus.cc:3037] T 23f477a03e25480895629bdccfa3c147 P 431b0793a99a4f9580ef7db0f84a656b [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:56.387370 23754 raft_consensus.cc:2454] T 23f477a03e25480895629bdccfa3c147 P 431b0793a99a4f9580ef7db0f84a656b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fce73fce9f754fb3ac38335434ac9137 in term 1.
I20260809 02:20:56.387609 23831 leader_election.cc:302] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 431b0793a99a4f9580ef7db0f84a656b, fce73fce9f754fb3ac38335434ac9137; no voters:
I20260809 02:20:56.387789 24115 raft_consensus.cc:2781] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:20:56.387774 24029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23f477a03e25480895629bdccfa3c147" candidate_uuid: "fce73fce9f754fb3ac38335434ac9137" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed284d66f745a7b26172252ef135db"
I20260809 02:20:56.387863 24029 raft_consensus.cc:3037] T 23f477a03e25480895629bdccfa3c147 P 88ed284d66f745a7b26172252ef135db [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:20:56.387949 24115 raft_consensus.cc:686] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137 [term 1 LEADER]: Becoming Leader. State: Replica: fce73fce9f754fb3ac38335434ac9137, State: Running, Role: LEADER
I20260809 02:20:56.388041 24115 consensus_queue.cc:237] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce73fce9f754fb3ac38335434ac9137" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 43607 } } peers { permanent_uuid: "88ed284d66f745a7b26172252ef135db" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 46003 } } peers { permanent_uuid: "431b0793a99a4f9580ef7db0f84a656b" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 45555 } }
I20260809 02:20:56.388804 24029 raft_consensus.cc:2454] T 23f477a03e25480895629bdccfa3c147 P 88ed284d66f745a7b26172252ef135db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fce73fce9f754fb3ac38335434ac9137 in term 1.
I20260809 02:20:56.389290 23580 catalog_manager.cc:5495] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137 reported cstate change: term changed from 0 to 1, leader changed from <none> to fce73fce9f754fb3ac38335434ac9137 (127.11.93.130). New cstate: current_term: 1 leader_uuid: "fce73fce9f754fb3ac38335434ac9137" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fce73fce9f754fb3ac38335434ac9137" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 43607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88ed284d66f745a7b26172252ef135db" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 46003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "431b0793a99a4f9580ef7db0f84a656b" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 45555 } health_report { overall_health: UNKNOWN } } }
Aug 09 02:20:56 dist-test-slave-w206 krb5kdc[23066](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242055, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for HTTP/127.11.93.148@KRBTEST.COM
I20260809 02:20:56.455591 24108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:56.451722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38080 (local address 127.11.93.130:43607)
0809 02:20:56.451807 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0809 02:20:56.451810 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:20:56.451822 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:20:56.451866 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:20:56.451867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:20:56.451892 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:20:56.451967 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:20:56.452170 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.452876 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.453960 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:20:56.454278 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:20:56.454355 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:20:56.454914 (+ 559us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:20:56.455085 (+ 171us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:20:56.455185 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 02:20:56.455454 (+ 269us) server_negotiation.cc:299] Negotiation successful
0809 02:20:56.455478 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:20:56.465703 23754 raft_consensus.cc:1261] T 23f477a03e25480895629bdccfa3c147 P 431b0793a99a4f9580ef7db0f84a656b [term 1 FOLLOWER]: Refusing update from remote peer fce73fce9f754fb3ac38335434ac9137: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:20:56.465731 24029 raft_consensus.cc:1261] T 23f477a03e25480895629bdccfa3c147 P 88ed284d66f745a7b26172252ef135db [term 1 FOLLOWER]: Refusing update from remote peer fce73fce9f754fb3ac38335434ac9137: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:20:56.466173 24115 consensus_queue.cc:1035] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "431b0793a99a4f9580ef7db0f84a656b" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 45555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:20:56.466467 24115 consensus_queue.cc:1035] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed284d66f745a7b26172252ef135db" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 46003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:20:56.469583 24128 mvcc.cc:205] Tried to move back new op lower bound from 7316447463273848832 to 7316447462965891072. Current Snapshot: MvccSnapshot[applied={T|T < 7316447463273848832}]
I20260809 02:20:56.476724 24130 mvcc.cc:205] Tried to move back new op lower bound from 7316447463273848832 to 7316447462965891072. Current Snapshot: MvccSnapshot[applied={T|T < 7316447463273848832}]
I20260809 02:20:56.480006 24129 mvcc.cc:205] Tried to move back new op lower bound from 7316447463273848832 to 7316447462965891072. Current Snapshot: MvccSnapshot[applied={T|T < 7316447463273848832}]
I20260809 02:20:56.485502 23579 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:20:56.485625 23579 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:20:56.486464 23579 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 96fb3bc89a4742f1a0529bb0a07b0f7e: Sending DeleteTablet for 3 replicas of tablet 23f477a03e25480895629bdccfa3c147
I20260809 02:20:56.486999 23880 tablet_service.cc:1514] Processing DeleteTablet for tablet 23f477a03e25480895629bdccfa3c147 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:56 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:38078
I20260809 02:20:56.486931 24022 tablet_service.cc:1514] Processing DeleteTablet for tablet 23f477a03e25480895629bdccfa3c147 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:56 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:50932
I20260809 02:20:56.487299 23715 tablet_service.cc:1514] Processing DeleteTablet for tablet 23f477a03e25480895629bdccfa3c147 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:20:56 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:56430
I20260809 02:20:56.487434 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 23667
I20260809 02:20:56.499433 24138 tablet_replica.cc:330] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137: stopping tablet replica
I20260809 02:20:56.499688 24138 raft_consensus.cc:2229] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:20:56.500010 24138 raft_consensus.cc:2258] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:20:56.500684 24138 ts_tablet_manager.cc:1905] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:20:56.502655 24138 ts_tablet_manager.cc:1918] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:20:56.502815 24138 log.cc:1196] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/23f477a03e25480895629bdccfa3c147
I20260809 02:20:56.503262 24138 ts_tablet_manager.cc:1939] T 23f477a03e25480895629bdccfa3c147 P fce73fce9f754fb3ac38335434ac9137: Deleting consensus metadata
I20260809 02:20:56.503844 23566 catalog_manager.cc:4841] TS fce73fce9f754fb3ac38335434ac9137 (127.11.93.130:43607): tablet 23f477a03e25480895629bdccfa3c147 (table test-table [id=cc45ab1ca87c412b97efe8276188ecf2]) successfully deleted
I20260809 02:20:56.504151 24139 tablet_replica.cc:330] T 23f477a03e25480895629bdccfa3c147 P 88ed284d66f745a7b26172252ef135db: stopping tablet replica
I20260809 02:20:56.504351 24139 raft_consensus.cc:2229] T 23f477a03e25480895629bdccfa3c147 P 88ed284d66f745a7b26172252ef135db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:20:56.504536 24139 raft_consensus.cc:2258] T 23f477a03e25480895629bdccfa3c147 P 88ed284d66f745a7b26172252ef135db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:20:56.505141 24139 ts_tablet_manager.cc:1905] T 23f477a03e25480895629bdccfa3c147 P 88ed284d66f745a7b26172252ef135db: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:20:56.507040 24139 ts_tablet_manager.cc:1918] T 23f477a03e25480895629bdccfa3c147 P 88ed284d66f745a7b26172252ef135db: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:20:56.507193 24139 log.cc:1196] T 23f477a03e25480895629bdccfa3c147 P 88ed284d66f745a7b26172252ef135db: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/23f477a03e25480895629bdccfa3c147
I20260809 02:20:56.507961 24139 ts_tablet_manager.cc:1939] T 23f477a03e25480895629bdccfa3c147 P 88ed284d66f745a7b26172252ef135db: Deleting consensus metadata
W20260809 02:20:56.508566 23564 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.93.129:45555 (error 108)
I20260809 02:20:56.508915 23562 catalog_manager.cc:4841] TS 88ed284d66f745a7b26172252ef135db (127.11.93.131:46003): tablet 23f477a03e25480895629bdccfa3c147 (table test-table [id=cc45ab1ca87c412b97efe8276188ecf2]) successfully deleted
I20260809 02:20:56.514008 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 23810
I20260809 02:20:56.522532 24104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:20:56.522362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:45555 (local address 127.0.0.1:56432)
0809 02:20:56.522427 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0809 02:20:56.522484 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.129:45555: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 02:20:56.522853 23564 catalog_manager.cc:4584] TS 431b0793a99a4f9580ef7db0f84a656b (127.11.93.129:45555): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 23f477a03e25480895629bdccfa3c147: Network error: Client connection negotiation failed: client connection to 127.11.93.129:45555: connect: Connection refused (error 111)
I20260809 02:20:56.532783 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 23957
I20260809 02:20:56.543406 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 23545
I20260809 02:20:56.550837 11638 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 02:20:56.895467 11638 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 02:20:56.895578 11638 mini_ranger.cc:66] Stopping Ranger...
I20260809 02:20:57.250385 11638 mini_ranger.cc:68] Stopped Ranger
2026-08-09 02:20:57.250 UTC [23098] LOG: received smart shutdown request
2026-08-09 02:20:57.254 UTC [23098] LOG: background worker "logical replication launcher" (PID 23108) exited with exit code 1
2026-08-09 02:20:57.255 UTC [23103] LOG: shutting down
2026-08-09 02:20:57.443 UTC [23098] LOG: database system is shut down
2026-08-09T02:20:57Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (48644 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:20:57 dist-test-slave-w206 krb5kdc[24151](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:20:57 dist-test-slave-w206 krb5kdc[24151](info): set up 2 sockets
Aug 09 02:20:57 dist-test-slave-w206 krb5kdc[24151](info): commencing operation
krb5kdc: starting...
W20260809 02:20:58.694330 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.110s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:20:58 dist-test-slave-w206 krb5kdc[24151](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242058, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:20:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:20:58Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.93.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.93.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.93.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/rangeradmin_127.11.93.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.93.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/rangeradmin_127.11.93.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.93.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.93.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.93.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/rangerlookup_127.11.93.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.93.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/rangerlookup_127.11.93.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.93.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.93.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.93.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/HTTP_127.11.93.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.93.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/HTTP_127.11.93.148@KRBTEST.COM.keytab.
I20260809 02:20:58.870509 11638 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskWEWZ6r/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/postgres -l logfile start
2026-08-09 02:21:01.496 UTC [24183] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 02:21:01.497 UTC [24183] LOG: listening on IPv4 address "127.11.93.148", port 49641
2026-08-09 02:21:01.500 UTC [24183] LOG: listening on Unix socket "/tmp/.s.PGSQL.49641"
2026-08-09 02:21:01.522 UTC [24186] LOG: database system was shut down at 2026-08-09 02:20:59 UTC
2026-08-09 02:21:01.526 UTC [24183] LOG: database system is ready to accept connections
I20260809 02:21:02.510118 11638 mini_postgres.cc:96] Postgres bound to 49641
2026-08-09 02:21:02.517 UTC [24194] FATAL: database "slave" does not exist
127.11.93.148:49641 - accepting connections
I20260809 02:21:02.518112 11638 mini_ranger.cc:161] Starting Ranger...
I20260809 02:21:02.535429 11638 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 02:21:03.042799 11638 mini_ranger.cc:87] Created ranger Postgres database
I20260809 02:21:03.042889 11638 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ranger-admin
2026-08-09 02:21:03,322 [I] DB FLAVOR :POSTGRES
2026-08-09 02:21:03,323 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 02:21:03,323 [I] Checking connection..
2026-08-09 02:21:03,323 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:49641/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 02:21:03,588 [I] Checking connection passed.
2026-08-09 02:21:03,588 [I] --------- Verifying version history table ---------
2026-08-09 02:21:03,589 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:49641/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 02:21:03,834 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 02:21:03,834 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:49641/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 02:21:04,091 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 02:21:04,091 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 02:21:04,091 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:49641/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 02:21:04.352 UTC [24262] WARNING: there is no transaction in progress
2026-08-09 02:21:04,359 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 02:21:04,360 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:49641/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 02:21:04,632 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 02:21:04,633 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 02:21:04,633 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:49641/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 02:21:04,889 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:49641/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 02:21:05,146 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:49641/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-w206.c.gcp-upstream.internal','N') ;"
2026-08-09 02:21:05,404 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:49641/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 02:21:05,664 [I] Table x_portal_user does not exist in database ranger
2026-08-09 02:21:05,664 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:49641/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 02:21:05,904 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 02:21:05,904 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:49641/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 02:21:06,166 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:49641/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 02:21:06,432 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 02:21:06,433 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:49641/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 02:21:07.416 UTC [24376] WARNING: there is no transaction in progress
2026-08-09 02:21:07.433 UTC [24376] WARNING: there is no transaction in progress
2026-08-09 02:21:07.450 UTC [24376] WARNING: there is no transaction in progress
2026-08-09 02:21:07.466 UTC [24376] WARNING: there is no transaction in progress
2026-08-09 02:21:07.483 UTC [24376] WARNING: there is no transaction in progress
2026-08-09 02:21:07.502 UTC [24376] WARNING: there is no transaction in progress
2026-08-09 02:21:07.560 UTC [24376] WARNING: there is no transaction in progress
2026-08-09 02:21:07.567 UTC [24376] WARNING: there is no transaction in progress
2026-08-09 02:21:07.582 UTC [24376] WARNING: there is no transaction in progress
2026-08-09 02:21:07.592 UTC [24376] WARNING: there is no transaction in progress
2026-08-09 02:21:07.603 UTC [24376] WARNING: there is no transaction in progress
2026-08-09 02:21:07.618 UTC [24376] WARNING: there is no transaction in progress
2026-08-09 02:21:07.627 UTC [24376] WARNING: there is no transaction in progress
2026-08-09 02:21:07.635 UTC [24376] WARNING: there is no transaction in progress
2026-08-09 02:21:07.642 UTC [24376] WARNING: there is no transaction in progress
2026-08-09 02:21:07.650 UTC [24376] WARNING: there is no transaction in progress
2026-08-09 02:21:08,333 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 02:21:08,333 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:49641/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 02:21:08,575 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 02:21:08,576 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:49641/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 02:21:08,844 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 02:21:08,844 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:49641/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 02:21:09,100 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 02:21:09,100 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:49641/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 02:21:09,371 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:49641/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 02:21:09,616 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:49641/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-w206.c.gcp-upstream.internal';"
2026-08-09 02:21:09,860 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 02:21:09,861 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:49641/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 02:21:10,125 [I] DB_PATCHES have already been applied
I20260809 02:21:10.131544 11638 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ranger-admin:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskWEWZ6r/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 02:21:10.131608 11638 mini_ranger.cc:193] Using host: 127.11.93.148
I20260809 02:21:10.135576 11638 mini_ranger.cc:227] Ranger admin URL: http://127.11.93.148:41231
Aug 09, 2026 2:21:10 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 2:21:10 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 2:21:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 2:21:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 2:21:10 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 2:21:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 2:21:11 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 02:21:11.296603 11638 mini_ranger.cc:160] Time spent starting Ranger: real 8.778s user 0.002s sys 0.009s
Aug 09, 2026 2:21:32 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 2:21:32 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 09, 2026 2:21:32 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 2:21:32 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 2:21:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 2:21:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 2:21:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 2:21:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 2:21:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 2:21:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 2:21:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 2:21:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 2:21:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 2:21:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 2:21:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 2:21:32 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 2:21:32 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 2:21:33 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 02:21:33.789924 11638 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.93.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.93.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.93.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/rangerkms_127.11.93.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.93.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/rangerkms_127.11.93.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.93.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.93.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.93.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/HTTP_127.11.93.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.93.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/HTTP_127.11.93.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 02:21:33 dist-test-slave-w206 krb5kdc[24151](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242093, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 02:21:33.894052 11638 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 02:21:33.903653 11638 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 02:21:34.756357 11638 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 02:21:34.756445 11638 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ranger-kms
I20260809 02:21:34.756469 11638 mini_ranger_kms.cc:227] Using postgres at 127.11.93.148:49641
2026-08-09 02:21:34,929 [I] DB FLAVOR :POSTGRES
2026-08-09 02:21:34,929 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 02:21:34,929 [I] Checking connection
2026-08-09 02:21:34,929 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:49641/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 02:21:35,192 [I] connection success
2026-08-09 02:21:35,193 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 02:21:35,193 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 02:21:35,193 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:49641/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 02:21:35,457 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 02:21:35,458 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 02:21:35,458 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 02:21:35,458 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.93.148:49641/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 02:21:35,719 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 02:21:36.209789 11638 mini_ranger_kms.cc:310] Created kms service
I20260809 02:21:36.420902 11638 mini_ranger_kms.cc:326] Created kudu user
I20260809 02:21:36.463652 11638 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 02:21:36 dist-test-slave-w206 krb5kdc[24151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242093, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.93.148@KRBTEST.COM
I20260809 02:21:36.863847 11638 mini_ranger_kms.cc:384] Added ranger policy
I20260809 02:21:36.863962 11638 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ranger-kms:/tmp/dist-test-taskWEWZ6r/build/release/bin/postgresql.jar:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskWEWZ6r/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 02:21:36.863981 11638 mini_ranger_kms.cc:240] Using host: 127.11.93.148
I20260809 02:21:36.868067 11638 mini_ranger_kms.cc:276] Ranger KMS PID: 24568
I20260809 02:21:36.868145 11638 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.93.148:43235
Aug 09, 2026 2:21:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 2:21:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 2:21:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 2:21:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 2:21:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 2:21:38 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260809 02:21:39.299288 11638 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.405s user 0.004s sys 0.151s
I20260809 02:21:39.299403 11638 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 02:21:39.299466 11638 mini_ranger_kms.cc:401] 127.11.93.148:43235/kms/v1/keys
Aug 09 02:21:39 dist-test-slave-w206 krb5kdc[24151](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786242099, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.93.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 09 02:21:40 dist-test-slave-w206 krb5kdc[24151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242099, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.93.148@KRBTEST.COM for HTTP/127.11.93.148@KRBTEST.COM
Aug 09 02:21:40 dist-test-slave-w206 krb5kdc[24151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242099, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.93.148@KRBTEST.COM for HTTP/127.11.93.148@KRBTEST.COM
Aug 09 02:21:42 dist-test-slave-w206 krb5kdc[24151](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242102, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:21:42.911031 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:33823
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:46693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:33823
--ranger_config_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.93.148:43235/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:43.005281 24622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:43.005542 24622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:43.005581 24622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:43.006767 24622 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:43.006840 24622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:43.006866 24622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:43.006892 24622 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:43.006919 24622 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:21:43.008932 24622 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:46693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.93.148:43235/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:33823
--ranger_config_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:33823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:43.009208 24622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:43.009451 24622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:21:43.014940 24622 server_base.cc:1034] running on GCE node
W20260809 02:21:43.015136 24631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:43.014940 24628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:43.015379 24629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:43.015688 24622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:43.016036 24622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:43.017230 24622 hybrid_clock.cc:648] HybridClock initialized: now 1786242103017206 us; error 43 us; skew 500 ppm
Aug 09 02:21:43 dist-test-slave-w206 krb5kdc[24151](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242103, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:43.020376 24622 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:21:43.020908 24622 webserver.cc:460] Webserver started at http://127.11.93.190:33375/ using document root <none> and password file <none>
I20260809 02:21:43.021138 24622 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:43.021198 24622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:43.021358 24622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:21:43 dist-test-slave-w206 krb5kdc[24151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242103, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for HTTP/127.11.93.148@KRBTEST.COM
I20260809 02:21:43.076537 24622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "f04a74f5a14c4449a802b2aec6ad1fb5"
format_stamp: "Formatted at 2026-08-09 02:21:43 on dist-test-slave-w206"
server_key: "d86c56e796fd943cf6546e840a14d68d"
server_key_iv: "efb1c1cfe92ba4d361e9a6a1252426dc"
server_key_version: "kuduclusterkey@0"
I20260809 02:21:43.076999 24622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "f04a74f5a14c4449a802b2aec6ad1fb5"
format_stamp: "Formatted at 2026-08-09 02:21:43 on dist-test-slave-w206"
server_key: "d86c56e796fd943cf6546e840a14d68d"
server_key_iv: "efb1c1cfe92ba4d361e9a6a1252426dc"
server_key_version: "kuduclusterkey@0"
I20260809 02:21:43.078894 24622 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260809 02:21:43.094097 24638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:43.094341 24622 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 02:21:43.094453 24622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "f04a74f5a14c4449a802b2aec6ad1fb5"
format_stamp: "Formatted at 2026-08-09 02:21:43 on dist-test-slave-w206"
server_key: "d86c56e796fd943cf6546e840a14d68d"
server_key_iv: "efb1c1cfe92ba4d361e9a6a1252426dc"
server_key_version: "kuduclusterkey@0"
I20260809 02:21:43.094558 24622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:43.106309 24622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:43.108510 24622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:43.108666 24622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:43.113663 24622 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:33823
I20260809 02:21:43.113692 24695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:33823 every 8 connection(s)
I20260809 02:21:43.114117 24622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:21:43.114868 24696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:43.117147 24696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5: Bootstrap starting.
I20260809 02:21:43.117745 24696 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:43.118048 24696 log.cc:824] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:43.118121 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 24622
I20260809 02:21:43.118255 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:21:43.118445 11638 external_mini_cluster.cc:1428] Setting key f2467ccdbcd7be16dc7e44ae203efca7
I20260809 02:21:43.118902 24696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5: No bootstrap required, opened a new log
I20260809 02:21:43.121086 24696 raft_consensus.cc:348] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f04a74f5a14c4449a802b2aec6ad1fb5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33823 } }
I20260809 02:21:43.121253 24696 raft_consensus.cc:374] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:43.121338 24696 raft_consensus.cc:729] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f04a74f5a14c4449a802b2aec6ad1fb5, State: Initialized, Role: FOLLOWER
I20260809 02:21:43.121490 24696 consensus_queue.cc:260] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f04a74f5a14c4449a802b2aec6ad1fb5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33823 } }
I20260809 02:21:43.121572 24696 raft_consensus.cc:388] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:21:43.121603 24696 raft_consensus.cc:482] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:21:43.121670 24696 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:43.122270 24696 raft_consensus.cc:504] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f04a74f5a14c4449a802b2aec6ad1fb5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33823 } }
I20260809 02:21:43.122390 24696 leader_election.cc:302] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f04a74f5a14c4449a802b2aec6ad1fb5; no voters:
I20260809 02:21:43.122583 24696 leader_election.cc:288] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:21:43.122614 24701 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:43.122853 24701 raft_consensus.cc:686] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [term 1 LEADER]: Becoming Leader. State: Replica: f04a74f5a14c4449a802b2aec6ad1fb5, State: Running, Role: LEADER
I20260809 02:21:43.122993 24696 sys_catalog.cc:564] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:43.123018 24701 consensus_queue.cc:237] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f04a74f5a14c4449a802b2aec6ad1fb5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33823 } }
I20260809 02:21:43.123384 24703 sys_catalog.cc:455] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f04a74f5a14c4449a802b2aec6ad1fb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f04a74f5a14c4449a802b2aec6ad1fb5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33823 } } }
I20260809 02:21:43.123538 24703 sys_catalog.cc:458] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:43.123804 24705 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:21:43.124410 24705 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:21:43.124763 24696 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 02:21:43.125396 24702 sys_catalog.cc:455] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f04a74f5a14c4449a802b2aec6ad1fb5. Latest consensus state: current_term: 1 leader_uuid: "f04a74f5a14c4449a802b2aec6ad1fb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f04a74f5a14c4449a802b2aec6ad1fb5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33823 } } }
I20260809 02:21:43.125537 24702 sys_catalog.cc:458] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:43.127385 24705 catalog_manager.cc:1347] Generated new cluster ID: 0014e9cbeff941769d66f991c89dcafd
I20260809 02:21:43.127441 24705 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 02:21:43 dist-test-slave-w206 krb5kdc[24151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242102, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:21:43.136500 24700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:43.119017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33116 (local address 127.11.93.190:33823)
0809 02:21:43.121375 (+ 2358us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:43.121384 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:43.121419 (+ 35us) server_negotiation.cc:407] Connection header received
0809 02:21:43.121531 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:43.121538 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:43.121596 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:43.121747 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:43.122511 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.123975 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.125057 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:43.125657 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:43.128627 (+ 2970us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:43.128749 (+ 122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:43.128752 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:43.128753 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:43.128762 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:43.130713 (+ 1951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:43.131141 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:43.131144 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:43.131145 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:43.133354 (+ 2209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:43.133683 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:43.133685 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:43.133685 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:43.134410 (+ 725us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:43.135190 (+ 780us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:43.135288 (+ 98us) server_negotiation.cc:299] Negotiation successful
0809 02:21:43.135882 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2306,"thread_start_us":79,"threads_started":1}
I20260809 02:21:43.142180 24705 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:21:43.143276 24705 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:21:43.148952 24705 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5: Generated new TSK 0
I20260809 02:21:43.149276 24705 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.93.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
I20260809 02:21:43.874050 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.93.148:43235/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:33823
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:46693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:43.975544 24743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:43.975769 24743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:43.975806 24743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:43.976979 24743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:43.977051 24743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:43.977097 24743 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:21:43.978570 24743 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:46693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.93.148:43235/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:33823
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24743
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:43.978822 24743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:43.979094 24743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:43.984192 24750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:43.984279 24749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:43.984541 24752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:43.984794 24743 server_base.cc:1034] running on GCE node
I20260809 02:21:43.984982 24743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:43.985196 24743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:43.986333 24743 hybrid_clock.cc:648] HybridClock initialized: now 1786242103986314 us; error 38 us; skew 500 ppm
Aug 09 02:21:43 dist-test-slave-w206 krb5kdc[24151](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242103, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:43.988996 24743 init.cc:377] Logged in from keytab as kudu/127.11.93.129@KRBTEST.COM (short username kudu)
I20260809 02:21:43.989418 24743 webserver.cc:460] Webserver started at http://127.11.93.129:46797/ using document root <none> and password file <none>
I20260809 02:21:43.989650 24743 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:43.989724 24743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:43.989869 24743 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:21:43 dist-test-slave-w206 krb5kdc[24151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242103, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for HTTP/127.11.93.148@KRBTEST.COM
I20260809 02:21:44.007939 24743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "c1ee03bec06e4ef7881140a3ae1fd9e7"
format_stamp: "Formatted at 2026-08-09 02:21:44 on dist-test-slave-w206"
server_key: "5b7a6086e8dbf7b4f0c84404455383a7"
server_key_iv: "5a1cb14f1d7cc97ae9692d71b707e95c"
server_key_version: "kuduclusterkey@0"
I20260809 02:21:44.008533 24743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "c1ee03bec06e4ef7881140a3ae1fd9e7"
format_stamp: "Formatted at 2026-08-09 02:21:44 on dist-test-slave-w206"
server_key: "5b7a6086e8dbf7b4f0c84404455383a7"
server_key_iv: "5a1cb14f1d7cc97ae9692d71b707e95c"
server_key_version: "kuduclusterkey@0"
I20260809 02:21:44.018611 24743 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.001s sys 0.000s
I20260809 02:21:44.036434 24759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:44.036722 24743 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260809 02:21:44.036840 24743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "c1ee03bec06e4ef7881140a3ae1fd9e7"
format_stamp: "Formatted at 2026-08-09 02:21:44 on dist-test-slave-w206"
server_key: "5b7a6086e8dbf7b4f0c84404455383a7"
server_key_iv: "5a1cb14f1d7cc97ae9692d71b707e95c"
server_key_version: "kuduclusterkey@0"
I20260809 02:21:44.036968 24743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:44.056870 24743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:44.059618 24743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:44.059861 24743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:44.060189 24743 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:44.060637 24743 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:44.060760 24743 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:44.060865 24743 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:44.060948 24743 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:44.070467 24743 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:43999
I20260809 02:21:44.071071 24743 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:21:44.071983 24881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:43999 every 8 connection(s)
I20260809 02:21:44.071996 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 24743
I20260809 02:21:44.072096 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:21:44.072335 11638 external_mini_cluster.cc:1428] Setting key 71504aacc2f1dd9edae26e2e6f79a98d
Aug 09 02:21:44 dist-test-slave-w206 krb5kdc[24151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242103, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.93.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.130@KRBTEST.COM" created.
I20260809 02:21:44.087069 24886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:44.073078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:46663 (local address 127.11.93.190:33823)
0809 02:21:44.075110 (+ 2032us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:44.075113 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:44.076155 (+ 1042us) server_negotiation.cc:407] Connection header received
0809 02:21:44.076188 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:44.076189 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:44.076207 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:44.076285 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:44.077168 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:44.078019 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:44.079704 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:44.080050 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:44.080150 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:44.083061 (+ 2911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:44.083063 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:44.083063 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:44.083072 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:44.085162 (+ 2090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:44.085625 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:44.085626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:44.085626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:44.085733 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:44.086067 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:44.086068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:44.086068 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:44.086205 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:44.086386 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:44.086820 (+ 434us) server_negotiation.cc:299] Negotiation successful
0809 02:21:44.086933 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1992,"thread_start_us":100,"threads_started":1}
I20260809 02:21:44.087491 24885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:44.072798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:33823 (local address 127.11.93.129:46663)
0809 02:21:44.073267 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:44.075178 (+ 1911us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:44.075993 (+ 815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:44.076434 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:44.076439 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:44.076749 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:44.077039 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:44.077046 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:44.078148 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:44.078149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:44.079571 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:44.079575 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:44.080194 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:44.080196 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:44.080359 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:44.081075 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:44.081088 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:44.082897 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:44.085279 (+ 2382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:44.085287 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:44.085289 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:44.085527 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:44.085844 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:44.085845 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:44.085845 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:44.085976 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:44.086411 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:44.086418 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:44.086624 (+ 206us) client_negotiation.cc:769] Sending connection context
0809 02:21:44.086748 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 02:21:44.086934 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":84,"threads_started":1}
I20260809 02:21:44.088033 24882 heartbeater.cc:347] Connected to a master server at 127.11.93.190:33823
I20260809 02:21:44.088145 24882 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:44.088368 24882 heartbeater.cc:511] Master 127.11.93.190:33823 requested a full tablet report, sending...
I20260809 02:21:44.088964 24656 ts_manager.cc:194] Registered new tserver with Master: c1ee03bec06e4ef7881140a3ae1fd9e7 (127.11.93.129:43999)
I20260809 02:21:44.089800 24656 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:46663
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
I20260809 02:21:44.106017 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.93.148:43235/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:33823
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:46693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:44.223454 24889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:44.223809 24889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:44.223872 24889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:44.225621 24889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:44.225682 24889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:44.225721 24889 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:21:44.228093 24889 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:46693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.93.148:43235/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:33823
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24889
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:44.228325 24889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:44.228614 24889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
Aug 09 02:21:44 dist-test-slave-w206 krb5kdc[24151](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786242104, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 02:21:44.237505 24899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:44.238009 24896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:44.241135 24889 server_base.cc:1034] running on GCE node
W20260809 02:21:44.241418 24897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:44.241768 24889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:44.242183 24889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:44.246394 24889 hybrid_clock.cc:648] HybridClock initialized: now 1786242104246365 us; error 45 us; skew 500 ppm
Aug 09 02:21:44 dist-test-slave-w206 krb5kdc[24151](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242104, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:44.250428 24889 init.cc:377] Logged in from keytab as kudu/127.11.93.130@KRBTEST.COM (short username kudu)
I20260809 02:21:44.250958 24889 webserver.cc:460] Webserver started at http://127.11.93.130:34269/ using document root <none> and password file <none>
I20260809 02:21:44.251303 24889 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:44.251376 24889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:44.251519 24889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:21:44 dist-test-slave-w206 krb5kdc[24151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242104, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for HTTP/127.11.93.148@KRBTEST.COM
I20260809 02:21:44.271565 24889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "0a8eaace933c49e0b2e8369ef4dec122"
format_stamp: "Formatted at 2026-08-09 02:21:44 on dist-test-slave-w206"
server_key: "b4a5029481a413b931380c74d848c20e"
server_key_iv: "ae8efb2d9ae6bdd89a100d7702f7d161"
server_key_version: "kuduclusterkey@0"
I20260809 02:21:44.272058 24889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "0a8eaace933c49e0b2e8369ef4dec122"
format_stamp: "Formatted at 2026-08-09 02:21:44 on dist-test-slave-w206"
server_key: "b4a5029481a413b931380c74d848c20e"
server_key_iv: "ae8efb2d9ae6bdd89a100d7702f7d161"
server_key_version: "kuduclusterkey@0"
I20260809 02:21:44.274472 24889 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:44.290828 24906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:44.291121 24889 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:21:44.291224 24889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "0a8eaace933c49e0b2e8369ef4dec122"
format_stamp: "Formatted at 2026-08-09 02:21:44 on dist-test-slave-w206"
server_key: "b4a5029481a413b931380c74d848c20e"
server_key_iv: "ae8efb2d9ae6bdd89a100d7702f7d161"
server_key_version: "kuduclusterkey@0"
I20260809 02:21:44.291316 24889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:44.308735 24889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:44.310884 24889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:44.311071 24889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:44.311306 24889 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:44.311695 24889 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:44.311749 24889 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:44.311789 24889 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:44.311825 24889 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:44.319221 24889 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:39745
I20260809 02:21:44.319398 25026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:39745 every 8 connection(s)
I20260809 02:21:44.319667 24889 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:21:44.326187 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 24889
I20260809 02:21:44.326299 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:21:44.326550 11638 external_mini_cluster.cc:1428] Setting key 9e8f28beab8e39931b12265ef262e824
Aug 09 02:21:44 dist-test-slave-w206 krb5kdc[24151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242104, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:21:44.332917 25030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:44.320509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:33823 (local address 127.11.93.130:45009)
0809 02:21:44.320693 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:44.320740 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:44.321390 (+ 650us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:44.321681 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:44.321685 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:44.321942 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:44.322219 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:44.322226 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:44.323263 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:44.323264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:44.324212 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:44.324215 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:44.324746 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:44.324747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:44.324865 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:44.325406 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:44.325416 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:44.327302 (+ 1886us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:44.331295 (+ 3993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:44.331302 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:44.331304 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:44.331591 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:44.331832 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:44.331832 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:44.331833 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:44.331962 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:44.332255 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:44.332260 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:44.332413 (+ 153us) client_negotiation.cc:769] Sending connection context
0809 02:21:44.332520 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 02:21:44.332669 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":91,"threads_started":1}
I20260809 02:21:44.333957 24886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:44.320490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:45009 (local address 127.11.93.190:33823)
0809 02:21:44.320539 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:44.320541 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:44.320850 (+ 309us) server_negotiation.cc:407] Connection header received
0809 02:21:44.321507 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:44.321508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:44.321525 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:44.321610 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:44.322329 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:44.323161 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:44.324303 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:44.324643 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:44.324732 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:44.329491 (+ 4759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:44.329492 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:44.329493 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:44.329501 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:44.331199 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:44.331688 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:44.331688 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:44.331689 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:44.331749 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:44.332037 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:44.332038 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:44.332038 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:44.332173 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:44.332230 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:44.333755 (+ 1525us) server_negotiation.cc:299] Negotiation successful
0809 02:21:44.333864 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 02:21:44.334476 25027 heartbeater.cc:347] Connected to a master server at 127.11.93.190:33823
I20260809 02:21:44.334585 25027 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:44.334782 25027 heartbeater.cc:511] Master 127.11.93.190:33823 requested a full tablet report, sending...
I20260809 02:21:44.335203 24656 ts_manager.cc:194] Registered new tserver with Master: 0a8eaace933c49e0b2e8369ef4dec122 (127.11.93.130:39745)
I20260809 02:21:44.335680 24656 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:45009
WARNING: no policy specified for kudu/127.11.93.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
I20260809 02:21:44.358795 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.93.148:43235/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:33823
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:46693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:44.483170 25034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:44.483533 25034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:44.483623 25034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:44.485397 25034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:44.485507 25034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:44.485589 25034 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:21:44.487871 25034 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:46693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.93.148:43235/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:33823
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25034
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:44.488291 25034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:44.488618 25034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:44.495249 25039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:44.495313 25042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:44.495570 25040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:44.498669 25034 server_base.cc:1034] running on GCE node
I20260809 02:21:44.498914 25034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:44.499253 25034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:44.500447 25034 hybrid_clock.cc:648] HybridClock initialized: now 1786242104500417 us; error 42 us; skew 500 ppm
Aug 09 02:21:44 dist-test-slave-w206 krb5kdc[24151](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242104, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:44.503724 25034 init.cc:377] Logged in from keytab as kudu/127.11.93.131@KRBTEST.COM (short username kudu)
I20260809 02:21:44.504283 25034 webserver.cc:460] Webserver started at http://127.11.93.131:35537/ using document root <none> and password file <none>
I20260809 02:21:44.504545 25034 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:44.504614 25034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:44.504769 25034 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:21:44 dist-test-slave-w206 krb5kdc[24151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242104, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for HTTP/127.11.93.148@KRBTEST.COM
I20260809 02:21:44.522255 25034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "aa274774174e4f98b92460bf67d80c76"
format_stamp: "Formatted at 2026-08-09 02:21:44 on dist-test-slave-w206"
server_key: "6894ae1b95d22c1e94e782f1ad770fd1"
server_key_iv: "f7ea251e3290462ca6f086bf72ed5185"
server_key_version: "kuduclusterkey@0"
I20260809 02:21:44.522927 25034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "aa274774174e4f98b92460bf67d80c76"
format_stamp: "Formatted at 2026-08-09 02:21:44 on dist-test-slave-w206"
server_key: "6894ae1b95d22c1e94e782f1ad770fd1"
server_key_iv: "f7ea251e3290462ca6f086bf72ed5185"
server_key_version: "kuduclusterkey@0"
I20260809 02:21:44.527365 25034 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260809 02:21:44.544799 25049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:44.545061 25034 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 02:21:44.545181 25034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "aa274774174e4f98b92460bf67d80c76"
format_stamp: "Formatted at 2026-08-09 02:21:44 on dist-test-slave-w206"
server_key: "6894ae1b95d22c1e94e782f1ad770fd1"
server_key_iv: "f7ea251e3290462ca6f086bf72ed5185"
server_key_version: "kuduclusterkey@0"
I20260809 02:21:44.545310 25034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:44.569854 25034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:44.574813 25034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:44.575022 25034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:44.575287 25034 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:44.575711 25034 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:44.575764 25034 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:44.575800 25034 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:44.575877 25034 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:44.583563 25034 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:40169
I20260809 02:21:44.584010 25034 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:21:44.584611 25171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:40169 every 8 connection(s)
I20260809 02:21:44.590320 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 25034
I20260809 02:21:44.590451 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:21:44.590837 11638 external_mini_cluster.cc:1428] Setting key 42be8431bff80634becda8db875d25fb
Aug 09 02:21:44 dist-test-slave-w206 krb5kdc[24151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242104, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:21:44.596642 24886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:44.584975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:47733 (local address 127.11.93.190:33823)
0809 02:21:44.585033 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:44.585035 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:44.585208 (+ 173us) server_negotiation.cc:407] Connection header received
0809 02:21:44.585879 (+ 671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:44.585881 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:44.585895 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:44.585976 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:44.586741 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:44.587588 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:44.589106 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:44.589411 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:44.589499 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:44.593010 (+ 3511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:44.593011 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:44.593012 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:44.593019 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:44.594782 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:44.595323 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:44.595324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:44.595324 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:44.595397 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:44.595789 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:44.595790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:44.595790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:44.595935 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:44.595980 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:44.596428 (+ 448us) server_negotiation.cc:299] Negotiation successful
0809 02:21:44.596519 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 02:21:44.597448 25174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:44.584795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:33823 (local address 127.11.93.131:47733)
0809 02:21:44.585044 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:44.585088 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:44.585743 (+ 655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:44.586051 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:44.586056 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:44.586319 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:44.586612 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:44.586618 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:44.587714 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:44.587715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:44.589001 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:44.589004 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:44.589535 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:44.589536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:44.589691 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:44.590826 (+ 1135us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:44.590836 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:44.592898 (+ 2062us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:44.594885 (+ 1987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:44.594893 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:44.594896 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:44.595239 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:44.595526 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:44.595527 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:44.595527 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:44.595687 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:44.596027 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:44.596033 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:44.596199 (+ 166us) client_negotiation.cc:769] Sending connection context
0809 02:21:44.597027 (+ 828us) client_negotiation.cc:240] Negotiation successful
0809 02:21:44.597203 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":80,"threads_started":1}
I20260809 02:21:44.598155 25172 heartbeater.cc:347] Connected to a master server at 127.11.93.190:33823
I20260809 02:21:44.598269 25172 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:44.598479 25172 heartbeater.cc:511] Master 127.11.93.190:33823 requested a full tablet report, sending...
I20260809 02:21:44.598873 24656 ts_manager.cc:194] Registered new tserver with Master: aa274774174e4f98b92460bf67d80c76 (127.11.93.131:40169)
I20260809 02:21:44.599364 24656 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:47733
I20260809 02:21:44.603706 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:21:44.604441 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 24743
I20260809 02:21:44.613099 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 24889
I20260809 02:21:44.619765 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 25034
I20260809 02:21:44.630944 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 24622
I20260809 02:21:44.640307 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:33823
--webserver_interface=127.11.93.190
--webserver_port=33375
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:46693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:33823
--ranger_config_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.93.148:43235/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.93.148:43235/kms with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:44.723449 25175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:44.723690 25175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:44.723731 25175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:44.724874 25175 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:44.724947 25175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:44.724972 25175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:44.724993 25175 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:44.725023 25175 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:21:44.726640 25175 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:46693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.93.148:43235/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:33823
--ranger_config_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:33823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=33375
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25175
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:44.726919 25175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:44.727181 25175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:44.732189 25181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:44.732196 25183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:44.732196 25180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:44.732419 25175 server_base.cc:1034] running on GCE node
I20260809 02:21:44.732651 25175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:44.732944 25175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:44.734113 25175 hybrid_clock.cc:648] HybridClock initialized: now 1786242104734098 us; error 27 us; skew 500 ppm
Aug 09 02:21:44 dist-test-slave-w206 krb5kdc[24151](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242104, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:44.736683 25175 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:21:44.737170 25175 webserver.cc:460] Webserver started at http://127.11.93.190:33375/ using document root <none> and password file <none>
I20260809 02:21:44.737416 25175 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:44.737493 25175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 02:21:44 dist-test-slave-w206 krb5kdc[24151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242104, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for HTTP/127.11.93.148@KRBTEST.COM
I20260809 02:21:44.812639 25175 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:44.813462 25193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:44.813701 25175 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:44.813839 25175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "f04a74f5a14c4449a802b2aec6ad1fb5"
format_stamp: "Formatted at 2026-08-09 02:21:43 on dist-test-slave-w206"
server_key: "d86c56e796fd943cf6546e840a14d68d"
server_key_iv: "efb1c1cfe92ba4d361e9a6a1252426dc"
server_key_version: "kuduclusterkey@0"
I20260809 02:21:44.814281 25175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:44.825109 25175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:44.827219 25175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:44.827379 25175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:44.831931 25175 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:33823
I20260809 02:21:44.831969 25248 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:33823 every 8 connection(s)
I20260809 02:21:44.832342 25175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:21:44.833550 25249 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:21:44.834210 25249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5: Bootstrap starting.
I20260809 02:21:44.836901 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 25175
I20260809 02:21:44.837287 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.93.148:43235/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:43999
--local_ip_for_outbound_sockets=127.11.93.129
--tserver_master_addrs=127.11.93.190:33823
--webserver_port=46797
--webserver_interface=127.11.93.129
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:46693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.93.148:43235/kms with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:21:44.843140 25249 log.cc:824] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:44.844955 25249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:21:44.845314 25249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5: Bootstrap complete.
I20260809 02:21:44.847846 25249 raft_consensus.cc:348] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f04a74f5a14c4449a802b2aec6ad1fb5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33823 } }
I20260809 02:21:44.848107 25249 raft_consensus.cc:729] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f04a74f5a14c4449a802b2aec6ad1fb5, State: Initialized, Role: FOLLOWER
I20260809 02:21:44.848327 25249 consensus_queue.cc:260] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f04a74f5a14c4449a802b2aec6ad1fb5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33823 } }
I20260809 02:21:44.848423 25249 raft_consensus.cc:388] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:21:44.848476 25249 raft_consensus.cc:482] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:21:44.848526 25249 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [term 1 FOLLOWER]: Advancing to term 2
I20260809 02:21:44.849541 25249 raft_consensus.cc:504] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f04a74f5a14c4449a802b2aec6ad1fb5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33823 } }
I20260809 02:21:44.849664 25249 leader_election.cc:302] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f04a74f5a14c4449a802b2aec6ad1fb5; no voters:
I20260809 02:21:44.849872 25249 leader_election.cc:288] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 02:21:44.849910 25253 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 02:21:44.850018 25253 raft_consensus.cc:686] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [term 2 LEADER]: Becoming Leader. State: Replica: f04a74f5a14c4449a802b2aec6ad1fb5, State: Running, Role: LEADER
I20260809 02:21:44.850152 25249 sys_catalog.cc:564] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:44.850186 25253 consensus_queue.cc:237] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f04a74f5a14c4449a802b2aec6ad1fb5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33823 } }
I20260809 02:21:44.850557 25254 sys_catalog.cc:455] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f04a74f5a14c4449a802b2aec6ad1fb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f04a74f5a14c4449a802b2aec6ad1fb5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33823 } } }
I20260809 02:21:44.850639 25254 sys_catalog.cc:458] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:44.850870 25255 sys_catalog.cc:455] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f04a74f5a14c4449a802b2aec6ad1fb5. Latest consensus state: current_term: 2 leader_uuid: "f04a74f5a14c4449a802b2aec6ad1fb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f04a74f5a14c4449a802b2aec6ad1fb5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33823 } } }
I20260809 02:21:44.850946 25255 sys_catalog.cc:458] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:44.851164 25259 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:21:44.851840 25259 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:21:44.852049 25259 catalog_manager.cc:1259] Loaded cluster ID: 0014e9cbeff941769d66f991c89dcafd
I20260809 02:21:44.852133 25259 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:21:44.852221 25249 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 02:21:44.856155 25259 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:21:44.856701 25259 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5: Loaded TSK: 0
I20260809 02:21:44.857007 25259 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 02:21:44.929774 25251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:44.930047 25251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:44.930087 25251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:44.931429 25251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:44.931499 25251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:44.931545 25251 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:21:44.933243 25251 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:46693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.93.148:43235/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:43999
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=46797
--tserver_master_addrs=127.11.93.190:33823
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:44.933506 25251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:44.933792 25251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:44.939128 25288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:44.939085 25286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:44.939333 25291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:44.940013 25251 server_base.cc:1034] running on GCE node
I20260809 02:21:44.940224 25251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:44.940531 25251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:44.941673 25251 hybrid_clock.cc:648] HybridClock initialized: now 1786242104941657 us; error 27 us; skew 500 ppm
Aug 09 02:21:44 dist-test-slave-w206 krb5kdc[24151](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242104, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:44.944480 25251 init.cc:377] Logged in from keytab as kudu/127.11.93.129@KRBTEST.COM (short username kudu)
I20260809 02:21:44.944995 25251 webserver.cc:460] Webserver started at http://127.11.93.129:46797/ using document root <none> and password file <none>
I20260809 02:21:44.945277 25251 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:44.945431 25251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 02:21:44 dist-test-slave-w206 krb5kdc[24151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242104, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for HTTP/127.11.93.148@KRBTEST.COM
I20260809 02:21:44.978860 25251 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260809 02:21:44.981992 25299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:44.982223 25251 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 02:21:44.982307 25251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "c1ee03bec06e4ef7881140a3ae1fd9e7"
format_stamp: "Formatted at 2026-08-09 02:21:44 on dist-test-slave-w206"
server_key: "5b7a6086e8dbf7b4f0c84404455383a7"
server_key_iv: "5a1cb14f1d7cc97ae9692d71b707e95c"
server_key_version: "kuduclusterkey@0"
I20260809 02:21:44.982766 25251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:45.002653 25251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:45.005025 25251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:45.005199 25251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:45.005503 25251 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:45.005904 25251 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:45.005959 25251 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:45.006028 25251 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:45.006071 25251 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:45.014803 25251 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:43999
I20260809 02:21:45.015404 25251 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:21:45.015581 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 25251
I20260809 02:21:45.015908 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.93.148:43235/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:39745
--local_ip_for_outbound_sockets=127.11.93.130
--tserver_master_addrs=127.11.93.190:33823
--webserver_port=34269
--webserver_interface=127.11.93.130
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:46693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.93.148:43235/kms with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:21:45.016793 25417 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:43999 every 8 connection(s)
Aug 09 02:21:45 dist-test-slave-w206 krb5kdc[24151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242104, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:21:45.039698 25424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:45.018759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:49555 (local address 127.11.93.190:33823)
0809 02:21:45.019021 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:45.019032 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:45.021088 (+ 2056us) server_negotiation.cc:407] Connection header received
0809 02:21:45.027413 (+ 6325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:45.027423 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:45.027503 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:45.027633 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:45.028662 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:45.030189 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:45.031978 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:45.032699 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:45.032796 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:45.035597 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:45.035602 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:45.035602 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:45.035614 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:45.037717 (+ 2103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:45.038196 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:45.038200 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:45.038200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:45.038317 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:45.038586 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:45.038587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:45.038587 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:45.038863 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:45.038929 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:45.039315 (+ 386us) server_negotiation.cc:299] Negotiation successful
0809 02:21:45.039453 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":94,"threads_started":1}
I20260809 02:21:45.040657 25422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:45.018290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:33823 (local address 127.11.93.129:49555)
0809 02:21:45.020898 (+ 2608us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:45.020941 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:45.027057 (+ 6116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:45.027875 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:45.027880 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:45.028176 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:45.028502 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:45.028509 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:45.030337 (+ 1828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:45.030338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:45.031861 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:45.031865 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:45.032943 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:45.032944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:45.033077 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:45.033723 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:45.033734 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:45.035449 (+ 1715us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:45.037815 (+ 2366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:45.037821 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:45.037824 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:45.038103 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:45.038387 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:45.038388 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:45.038388 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:45.038515 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:45.038963 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:45.038969 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:45.039132 (+ 163us) client_negotiation.cc:769] Sending connection context
0809 02:21:45.040205 (+ 1073us) client_negotiation.cc:240] Negotiation successful
0809 02:21:45.040374 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2563,"thread_start_us":107,"threads_started":1}
I20260809 02:21:45.041936 25418 heartbeater.cc:347] Connected to a master server at 127.11.93.190:33823
I20260809 02:21:45.042028 25418 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:45.042212 25418 heartbeater.cc:511] Master 127.11.93.190:33823 requested a full tablet report, sending...
W20260809 02:21:45.043424 25418 heartbeater.cc:644] Failed to heartbeat to 127.11.93.190:33823 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 02:21:45.043503 25418 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:45.043574 25418 heartbeater.cc:511] Master 127.11.93.190:33823 requested a full tablet report, sending...
I20260809 02:21:45.043962 25418 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:45.044032 25418 heartbeater.cc:511] Master 127.11.93.190:33823 requested a full tablet report, sending...
W20260809 02:21:45.044332 25418 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:21:45.129621 25421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:45.129907 25421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:45.129945 25421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:45.131724 25421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:45.131786 25421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:45.131826 25421 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:21:45.133617 25421 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:46693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.93.148:43235/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:39745
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=34269
--tserver_master_addrs=127.11.93.190:33823
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:45.133968 25421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:45.134218 25421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:45.139664 25429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:45.139672 25432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:45.139678 25430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:45.140682 25421 server_base.cc:1034] running on GCE node
I20260809 02:21:45.140983 25421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:45.141273 25421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:45.142455 25421 hybrid_clock.cc:648] HybridClock initialized: now 1786242105142428 us; error 41 us; skew 500 ppm
Aug 09 02:21:45 dist-test-slave-w206 krb5kdc[24151](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242105, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:45.146232 25421 init.cc:377] Logged in from keytab as kudu/127.11.93.130@KRBTEST.COM (short username kudu)
I20260809 02:21:45.146808 25421 webserver.cc:460] Webserver started at http://127.11.93.130:34269/ using document root <none> and password file <none>
I20260809 02:21:45.147172 25421 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:45.147262 25421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 02:21:45 dist-test-slave-w206 krb5kdc[24151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242105, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for HTTP/127.11.93.148@KRBTEST.COM
I20260809 02:21:45.168597 25421 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260809 02:21:45.169780 25441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:45.170001 25421 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 02:21:45.170091 25421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "0a8eaace933c49e0b2e8369ef4dec122"
format_stamp: "Formatted at 2026-08-09 02:21:44 on dist-test-slave-w206"
server_key: "b4a5029481a413b931380c74d848c20e"
server_key_iv: "ae8efb2d9ae6bdd89a100d7702f7d161"
server_key_version: "kuduclusterkey@0"
I20260809 02:21:45.170565 25421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:45.195873 25421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:45.198246 25421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:45.198431 25421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:45.198666 25421 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:45.199079 25421 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:45.199136 25421 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:45.199168 25421 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:45.199185 25421 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:45.207151 25421 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:39745
I20260809 02:21:45.207253 25559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:39745 every 8 connection(s)
I20260809 02:21:45.207756 25421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
Aug 09 02:21:45 dist-test-slave-w206 krb5kdc[24151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242105, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:21:45.217170 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 25421
I20260809 02:21:45.217509 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.93.148:43235/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:40169
--local_ip_for_outbound_sockets=127.11.93.131
--tserver_master_addrs=127.11.93.190:33823
--webserver_port=35537
--webserver_interface=127.11.93.131
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:46693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.93.148:43235/kms with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:21:45.218689 25424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:45.208885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:47261 (local address 127.11.93.190:33823)
0809 02:21:45.208932 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:45.208934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:45.208945 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:21:45.209682 (+ 737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:45.209684 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:45.209702 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:45.209772 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:45.210581 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:45.211167 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:45.212201 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:45.212424 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:45.212517 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:45.215087 (+ 2570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:45.215089 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:45.215089 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:45.215096 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:45.216839 (+ 1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:45.217443 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:45.217445 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:45.217445 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:45.217505 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:45.217834 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:45.217835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:45.217835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:45.217987 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:45.218030 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:45.218440 (+ 410us) server_negotiation.cc:299] Negotiation successful
0809 02:21:45.218543 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 02:21:45.219288 25562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:45.208573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:33823 (local address 127.11.93.130:47261)
0809 02:21:45.208784 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:45.208835 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:45.209535 (+ 700us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:45.209867 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:45.209871 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:45.210131 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:45.210428 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:45.210453 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:45.211267 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:45.211268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:45.212096 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:45.212099 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:45.212548 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:45.212550 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:45.212679 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:45.213282 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:45.213293 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:45.214933 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:45.216959 (+ 2026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:45.216967 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:45.216969 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:45.217309 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:45.217593 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:45.217593 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:45.217594 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:45.217755 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:45.218080 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:45.218087 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:45.218273 (+ 186us) client_negotiation.cc:769] Sending connection context
0809 02:21:45.218778 (+ 505us) client_negotiation.cc:240] Negotiation successful
0809 02:21:45.218957 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":99,"threads_started":1}
I20260809 02:21:45.220497 25560 heartbeater.cc:347] Connected to a master server at 127.11.93.190:33823
I20260809 02:21:45.220654 25560 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:45.220901 25560 heartbeater.cc:511] Master 127.11.93.190:33823 requested a full tablet report, sending...
W20260809 02:21:45.221587 25560 heartbeater.cc:644] Failed to heartbeat to 127.11.93.190:33823 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 02:21:45.221715 25560 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:45.221817 25560 heartbeater.cc:511] Master 127.11.93.190:33823 requested a full tablet report, sending...
I20260809 02:21:45.222132 25560 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:45.222244 25560 heartbeater.cc:511] Master 127.11.93.190:33823 requested a full tablet report, sending...
W20260809 02:21:45.222576 25560 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:21:45.343338 25563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:45.343637 25563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:45.343678 25563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:45.345810 25563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:45.345883 25563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:45.345932 25563 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:21:45.348407 25563 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:46693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.93.148:43235/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:40169
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=35537
--tserver_master_addrs=127.11.93.190:33823
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:45.348703 25563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:45.349035 25563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:45.358628 25569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:45.358669 25572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:45.358870 25570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:45.359443 25563 server_base.cc:1034] running on GCE node
I20260809 02:21:45.359671 25563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:45.359987 25563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:45.361176 25563 hybrid_clock.cc:648] HybridClock initialized: now 1786242105361162 us; error 29 us; skew 500 ppm
Aug 09 02:21:45 dist-test-slave-w206 krb5kdc[24151](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242105, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:45.364794 25563 init.cc:377] Logged in from keytab as kudu/127.11.93.131@KRBTEST.COM (short username kudu)
I20260809 02:21:45.365375 25563 webserver.cc:460] Webserver started at http://127.11.93.131:35537/ using document root <none> and password file <none>
I20260809 02:21:45.365721 25563 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:45.365875 25563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 02:21:45 dist-test-slave-w206 krb5kdc[24151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242105, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for HTTP/127.11.93.148@KRBTEST.COM
I20260809 02:21:45.390228 25563 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.000s sys 0.001s
I20260809 02:21:45.391510 25581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:45.391767 25563 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 02:21:45.391877 25563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "aa274774174e4f98b92460bf67d80c76"
format_stamp: "Formatted at 2026-08-09 02:21:44 on dist-test-slave-w206"
server_key: "6894ae1b95d22c1e94e782f1ad770fd1"
server_key_iv: "f7ea251e3290462ca6f086bf72ed5185"
server_key_version: "kuduclusterkey@0"
I20260809 02:21:45.392343 25563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:45.411231 25563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:45.413471 25563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:45.413645 25563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:45.413910 25563 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:45.414302 25563 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:45.414358 25563 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:45.414410 25563 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:45.414436 25563 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:45.421972 25563 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:40169
I20260809 02:21:45.422063 25703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:40169 every 8 connection(s)
I20260809 02:21:45.422499 25563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:21:45.427476 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 25563
Aug 09 02:21:45 dist-test-slave-w206 krb5kdc[24151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242105, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:21:45.433425 25424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:45.423371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:53011 (local address 127.11.93.190:33823)
0809 02:21:45.423443 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:45.423446 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:45.423637 (+ 191us) server_negotiation.cc:407] Connection header received
0809 02:21:45.424328 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:45.424330 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:45.424345 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:45.424418 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:45.425191 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:45.425989 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:45.427205 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:45.427516 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:45.427595 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:45.430048 (+ 2453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:45.430050 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:45.430050 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:45.430058 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:45.431814 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:45.432279 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:45.432280 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:45.432280 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:45.432340 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:45.432614 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:45.432615 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:45.432616 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:45.432756 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:45.432829 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:45.433208 (+ 379us) server_negotiation.cc:299] Negotiation successful
0809 02:21:45.433315 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:21:45.433960 25706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:45.423314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:33823 (local address 127.11.93.131:53011)
0809 02:21:45.423500 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:45.423540 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:45.424119 (+ 579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:45.424496 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:45.424501 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:45.424767 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:45.425064 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:45.425071 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:45.426105 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:45.426105 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:45.427113 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:45.427115 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:45.427688 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:45.427689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:45.427841 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:45.428470 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:45.428489 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:45.429946 (+ 1457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:45.431907 (+ 1961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:45.431915 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:45.431917 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:45.432183 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:45.432427 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:45.432428 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:45.432430 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:45.432546 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:45.432840 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:45.432847 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:45.433022 (+ 175us) client_negotiation.cc:769] Sending connection context
0809 02:21:45.433534 (+ 512us) client_negotiation.cc:240] Negotiation successful
0809 02:21:45.433720 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":89,"threads_started":1}
I20260809 02:21:45.434437 25704 heartbeater.cc:347] Connected to a master server at 127.11.93.190:33823
I20260809 02:21:45.434548 25704 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:45.434748 25704 heartbeater.cc:511] Master 127.11.93.190:33823 requested a full tablet report, sending...
W20260809 02:21:45.435532 25704 heartbeater.cc:644] Failed to heartbeat to 127.11.93.190:33823 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 02:21:45.435614 25704 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:45.435678 25704 heartbeater.cc:511] Master 127.11.93.190:33823 requested a full tablet report, sending...
I20260809 02:21:45.436064 25704 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:45.436141 25704 heartbeater.cc:511] Master 127.11.93.190:33823 requested a full tablet report, sending...
W20260809 02:21:45.437600 25704 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 02:21:45.438431 25707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:45.427948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33130 (local address 127.11.93.190:33823)
0809 02:21:45.428402 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:45.428404 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:45.428411 (+ 7us) server_negotiation.cc:407] Connection header received
0809 02:21:45.428429 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:45.428429 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:45.428439 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:45.428526 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:45.429130 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:45.429641 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:45.430883 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:45.431204 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:45.431279 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:45.432735 (+ 1456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:45.432736 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:45.432736 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:45.432742 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:45.434668 (+ 1926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:45.436188 (+ 1520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:45.436189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:45.436190 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:45.436267 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:45.436936 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:45.436937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:45.436937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:45.437075 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:45.437264 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:45.438240 (+ 976us) server_negotiation.cc:299] Negotiation successful
0809 02:21:45.438336 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":80,"threads_started":1}
Aug 09 02:21:45 dist-test-slave-w206 krb5kdc[24151](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786242105, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:46.044533 25418 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:46.044696 25418 heartbeater.cc:511] Master 127.11.93.190:33823 requested a full tablet report, sending...
I20260809 02:21:46.045147 25211 ts_manager.cc:194] Registered new tserver with Master: c1ee03bec06e4ef7881140a3ae1fd9e7 (127.11.93.129:43999)
I20260809 02:21:46.046182 25211 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:49555
I20260809 02:21:46.224509 25560 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:46.224676 25560 heartbeater.cc:511] Master 127.11.93.190:33823 requested a full tablet report, sending...
I20260809 02:21:46.225168 25211 ts_manager.cc:194] Registered new tserver with Master: 0a8eaace933c49e0b2e8369ef4dec122 (127.11.93.130:39745)
I20260809 02:21:46.225719 25211 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:47261
Aug 09 02:21:46 dist-test-slave-w206 krb5kdc[24151](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242105, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for HTTP/127.11.93.148@KRBTEST.COM
I20260809 02:21:46.437779 25704 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:46.437952 25704 heartbeater.cc:511] Master 127.11.93.190:33823 requested a full tablet report, sending...
I20260809 02:21:46.438259 25211 ts_manager.cc:194] Registered new tserver with Master: aa274774174e4f98b92460bf67d80c76 (127.11.93.131:40169)
I20260809 02:21:46.438665 25211 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:53011
I20260809 02:21:46.447839 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:21:46.456259 25726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:46.449115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52310 (local address 127.11.93.190:33823)
0809 02:21:46.449258 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:46.449261 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:46.449333 (+ 72us) server_negotiation.cc:407] Connection header received
0809 02:21:46.449420 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:46.449420 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:46.449431 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:46.449494 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:46.450208 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.450942 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.451734 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.452010 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.452086 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:46.453363 (+ 1277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:46.453364 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:46.453364 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:46.453375 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:46.455033 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:46.455430 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:46.455431 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:46.455432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:46.455500 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:46.455711 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:46.455712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:46.455712 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:46.455829 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:46.455941 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:46.456041 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 02:21:46.456127 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":94,"threads_started":1}
I20260809 02:21:46.458427 25211 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52310:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:21:46.461084 25211 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:21:46.469955 25735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:46.464582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:43999 (local address 127.0.0.1:37518)
0809 02:21:46.465366 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:46.465377 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:46.465441 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:46.465682 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:46.465685 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:46.465688 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:46.465774 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:46.465776 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.466945 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.466947 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:46.468595 (+ 1648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:46.468598 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.469642 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.469644 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:46.469739 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:46.469753 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 02:21:46.469824 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 02:21:46.469875 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":763,"thread_start_us":87,"threads_started":1}
I20260809 02:21:46.470407 25737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:46.465016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37518 (local address 127.11.93.129:43999)
0809 02:21:46.465242 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:46.465246 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:46.465449 (+ 203us) server_negotiation.cc:407] Connection header received
0809 02:21:46.465515 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:46.465517 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:46.465531 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:46.465614 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:46.465863 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.466844 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.468706 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.469468 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.469549 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:46.469605 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:46.470269 (+ 664us) server_negotiation.cc:299] Negotiation successful
0809 02:21:46.470320 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":64,"threads_started":1}
I20260809 02:21:46.471532 25341 tablet_service.cc:1467] Processing CreateTablet for tablet 8e2853b855ac40929f94cf7c505dc28c (DEFAULT_TABLE table=test-table [id=42df60a34a994a4093ebdffe408fbc78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:46.471958 25341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e2853b855ac40929f94cf7c505dc28c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:46.474735 25736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:46.464902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39148 (local address 127.11.93.131:40169)
0809 02:21:46.465190 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:46.465194 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:46.470817 (+ 5623us) server_negotiation.cc:407] Connection header received
0809 02:21:46.470857 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:46.470860 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:46.470877 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:46.470951 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:46.471201 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.472143 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.473318 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.474111 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.474191 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:46.474249 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:46.474577 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 02:21:46.474658 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":55,"threads_started":1}
I20260809 02:21:46.474881 25735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:46.464782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:40169 (local address 127.0.0.1:39148)
0809 02:21:46.470698 (+ 5916us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:46.470709 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:46.470756 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:46.471089 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:46.471090 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:46.471092 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:46.471123 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:46.471124 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.472245 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.472246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:46.473214 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:46.473217 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.474285 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.474286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:46.474347 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:46.474350 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:21:46.474416 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 02:21:46.474454 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5905,"thread_start_us":69,"threads_started":1}
I20260809 02:21:46.475905 25623 tablet_service.cc:1467] Processing CreateTablet for tablet 8e2853b855ac40929f94cf7c505dc28c (DEFAULT_TABLE table=test-table [id=42df60a34a994a4093ebdffe408fbc78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:46.476327 25623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e2853b855ac40929f94cf7c505dc28c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:46.476972 25738 tablet_bootstrap.cc:492] T 8e2853b855ac40929f94cf7c505dc28c P c1ee03bec06e4ef7881140a3ae1fd9e7: Bootstrap starting.
I20260809 02:21:46.477655 25738 tablet_bootstrap.cc:654] T 8e2853b855ac40929f94cf7c505dc28c P c1ee03bec06e4ef7881140a3ae1fd9e7: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:46.477947 25738 log.cc:824] T 8e2853b855ac40929f94cf7c505dc28c P c1ee03bec06e4ef7881140a3ae1fd9e7: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:46.479034 25738 tablet_bootstrap.cc:492] T 8e2853b855ac40929f94cf7c505dc28c P c1ee03bec06e4ef7881140a3ae1fd9e7: No bootstrap required, opened a new log
I20260809 02:21:46.479110 25738 ts_tablet_manager.cc:1397] T 8e2853b855ac40929f94cf7c505dc28c P c1ee03bec06e4ef7881140a3ae1fd9e7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:46.481609 25738 raft_consensus.cc:348] T 8e2853b855ac40929f94cf7c505dc28c P c1ee03bec06e4ef7881140a3ae1fd9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8eaace933c49e0b2e8369ef4dec122" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 39745 } } peers { permanent_uuid: "c1ee03bec06e4ef7881140a3ae1fd9e7" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43999 } } peers { permanent_uuid: "aa274774174e4f98b92460bf67d80c76" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 40169 } }
I20260809 02:21:46.481837 25738 raft_consensus.cc:374] T 8e2853b855ac40929f94cf7c505dc28c P c1ee03bec06e4ef7881140a3ae1fd9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:46.481897 25738 raft_consensus.cc:729] T 8e2853b855ac40929f94cf7c505dc28c P c1ee03bec06e4ef7881140a3ae1fd9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1ee03bec06e4ef7881140a3ae1fd9e7, State: Initialized, Role: FOLLOWER
I20260809 02:21:46.482084 25738 consensus_queue.cc:260] T 8e2853b855ac40929f94cf7c505dc28c P c1ee03bec06e4ef7881140a3ae1fd9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8eaace933c49e0b2e8369ef4dec122" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 39745 } } peers { permanent_uuid: "c1ee03bec06e4ef7881140a3ae1fd9e7" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43999 } } peers { permanent_uuid: "aa274774174e4f98b92460bf67d80c76" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 40169 } }
I20260809 02:21:46.482431 25738 ts_tablet_manager.cc:1428] T 8e2853b855ac40929f94cf7c505dc28c P c1ee03bec06e4ef7881140a3ae1fd9e7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 02:21:46.482585 25418 heartbeater.cc:503] Master 127.11.93.190:33823 was elected leader, sending a full tablet report...
I20260809 02:21:46.482877 25734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:46.464337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:39745 (local address 127.0.0.1:60916)
0809 02:21:46.464741 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:46.464782 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:46.464852 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:46.479362 (+ 14510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:46.479363 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:46.479366 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:46.479436 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:46.479437 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.480637 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.480639 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:46.481720 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:46.481723 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.482643 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.482645 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:46.482732 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:46.482736 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:21:46.482767 (+ 31us) client_negotiation.cc:240] Negotiation successful
0809 02:21:46.482805 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":91,"threads_started":1}
I20260809 02:21:46.483431 25733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:46.464451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60916 (local address 127.11.93.130:39745)
0809 02:21:46.479117 (+ 14666us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:46.479122 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:46.479134 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:21:46.479169 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:46.479171 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:46.479188 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:46.479515 (+ 327us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:46.479599 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.480532 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.481824 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.482541 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.483206 (+ 665us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:46.483277 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:46.483302 (+ 25us) server_negotiation.cc:299] Negotiation successful
0809 02:21:46.483341 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14624,"thread_start_us":74,"threads_started":1}
I20260809 02:21:46.484228 25740 tablet_bootstrap.cc:492] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76: Bootstrap starting.
I20260809 02:21:46.484228 25489 tablet_service.cc:1467] Processing CreateTablet for tablet 8e2853b855ac40929f94cf7c505dc28c (DEFAULT_TABLE table=test-table [id=42df60a34a994a4093ebdffe408fbc78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:46.484604 25489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e2853b855ac40929f94cf7c505dc28c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:46.484943 25740 tablet_bootstrap.cc:654] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:46.485258 25740 log.cc:824] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:46.486117 25740 tablet_bootstrap.cc:492] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76: No bootstrap required, opened a new log
I20260809 02:21:46.486230 25740 ts_tablet_manager.cc:1397] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:46.488333 25743 tablet_bootstrap.cc:492] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122: Bootstrap starting.
I20260809 02:21:46.489048 25743 tablet_bootstrap.cc:654] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:46.489405 25743 log.cc:824] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:46.489364 25740 raft_consensus.cc:348] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8eaace933c49e0b2e8369ef4dec122" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 39745 } } peers { permanent_uuid: "c1ee03bec06e4ef7881140a3ae1fd9e7" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43999 } } peers { permanent_uuid: "aa274774174e4f98b92460bf67d80c76" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 40169 } }
I20260809 02:21:46.489619 25740 raft_consensus.cc:374] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:46.489698 25740 raft_consensus.cc:729] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa274774174e4f98b92460bf67d80c76, State: Initialized, Role: FOLLOWER
I20260809 02:21:46.489858 25740 consensus_queue.cc:260] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8eaace933c49e0b2e8369ef4dec122" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 39745 } } peers { permanent_uuid: "c1ee03bec06e4ef7881140a3ae1fd9e7" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43999 } } peers { permanent_uuid: "aa274774174e4f98b92460bf67d80c76" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 40169 } }
I20260809 02:21:46.490193 25740 ts_tablet_manager.cc:1428] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260809 02:21:46.490336 25743 tablet_bootstrap.cc:492] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122: No bootstrap required, opened a new log
I20260809 02:21:46.490355 25704 heartbeater.cc:503] Master 127.11.93.190:33823 was elected leader, sending a full tablet report...
I20260809 02:21:46.490404 25743 ts_tablet_manager.cc:1397] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:46.492869 25743 raft_consensus.cc:348] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8eaace933c49e0b2e8369ef4dec122" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 39745 } } peers { permanent_uuid: "c1ee03bec06e4ef7881140a3ae1fd9e7" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43999 } } peers { permanent_uuid: "aa274774174e4f98b92460bf67d80c76" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 40169 } }
I20260809 02:21:46.493044 25743 raft_consensus.cc:374] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:46.493081 25743 raft_consensus.cc:729] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a8eaace933c49e0b2e8369ef4dec122, State: Initialized, Role: FOLLOWER
I20260809 02:21:46.493201 25743 consensus_queue.cc:260] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8eaace933c49e0b2e8369ef4dec122" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 39745 } } peers { permanent_uuid: "c1ee03bec06e4ef7881140a3ae1fd9e7" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43999 } } peers { permanent_uuid: "aa274774174e4f98b92460bf67d80c76" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 40169 } }
I20260809 02:21:46.493439 25743 ts_tablet_manager.cc:1428] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 02:21:46.493484 25560 heartbeater.cc:503] Master 127.11.93.190:33823 was elected leader, sending a full tablet report...
W20260809 02:21:46.518610 25419 tablet.cc:2369] T 8e2853b855ac40929f94cf7c505dc28c P c1ee03bec06e4ef7881140a3ae1fd9e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:21:46.527763 25746 raft_consensus.cc:482] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:21:46.527927 25746 raft_consensus.cc:504] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8eaace933c49e0b2e8369ef4dec122" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 39745 } } peers { permanent_uuid: "c1ee03bec06e4ef7881140a3ae1fd9e7" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43999 } } peers { permanent_uuid: "aa274774174e4f98b92460bf67d80c76" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 40169 } }
I20260809 02:21:46.528379 25746 leader_election.cc:288] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a8eaace933c49e0b2e8369ef4dec122 (127.11.93.130:39745), c1ee03bec06e4ef7881140a3ae1fd9e7 (127.11.93.129:43999)
I20260809 02:21:46.532665 25733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:46.528668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:37261 (local address 127.11.93.130:39745)
0809 02:21:46.528716 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:46.528719 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:46.528924 (+ 205us) server_negotiation.cc:407] Connection header received
0809 02:21:46.529085 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:46.529086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:46.529098 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:46.529157 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:46.529383 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.530126 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.531666 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.532255 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.532305 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:46.532325 (+ 20us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:46.532536 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 02:21:46.532594 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 02:21:46.532943 25737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:46.528943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:55633 (local address 127.11.93.129:43999)
0809 02:21:46.528985 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:46.528987 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:46.529157 (+ 170us) server_negotiation.cc:407] Connection header received
0809 02:21:46.529278 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:46.529279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:46.529290 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:46.529324 (+ 34us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:46.529569 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.530343 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.531861 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.532493 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.532547 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:46.532555 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:46.532820 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 02:21:46.532865 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 02:21:46.533296 25748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:46.528561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:39745 (local address 127.11.93.131:37261)
0809 02:21:46.528838 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:46.528851 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:46.528956 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:46.529222 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:46.529224 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:46.529226 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:46.529307 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:46.529309 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.530248 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.530248 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:46.531566 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:46.531569 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.532398 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.532399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:46.532463 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:46.532466 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:21:46.532963 (+ 497us) client_negotiation.cc:240] Negotiation successful
0809 02:21:46.533161 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"mutex_wait_us":73,"thread_start_us":113,"threads_started":1}
I20260809 02:21:46.533319 25749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:46.528772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:43999 (local address 127.11.93.131:55633)
0809 02:21:46.529097 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:46.529107 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:46.529195 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:46.529396 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:46.529396 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:46.529398 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:46.529477 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:46.529479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.530454 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.530455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:46.531745 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:46.531749 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.532639 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.532639 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:46.532725 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:46.532729 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:21:46.533042 (+ 313us) client_negotiation.cc:240] Negotiation successful
0809 02:21:46.533194 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":59,"threads_started":1}
I20260809 02:21:46.533795 25510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2853b855ac40929f94cf7c505dc28c" candidate_uuid: "aa274774174e4f98b92460bf67d80c76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a8eaace933c49e0b2e8369ef4dec122" is_pre_election: true
I20260809 02:21:46.533967 25510 raft_consensus.cc:2454] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa274774174e4f98b92460bf67d80c76 in term 0.
I20260809 02:21:46.534255 25584 leader_election.cc:302] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a8eaace933c49e0b2e8369ef4dec122, aa274774174e4f98b92460bf67d80c76; no voters:
I20260809 02:21:46.534420 25746 raft_consensus.cc:2781] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:21:46.534467 25746 raft_consensus.cc:482] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:21:46.534495 25746 raft_consensus.cc:3037] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:46.535373 25746 raft_consensus.cc:504] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8eaace933c49e0b2e8369ef4dec122" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 39745 } } peers { permanent_uuid: "c1ee03bec06e4ef7881140a3ae1fd9e7" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43999 } } peers { permanent_uuid: "aa274774174e4f98b92460bf67d80c76" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 40169 } }
I20260809 02:21:46.535496 25746 leader_election.cc:288] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76 [CANDIDATE]: Term 1 election: Requested vote from peers 0a8eaace933c49e0b2e8369ef4dec122 (127.11.93.130:39745), c1ee03bec06e4ef7881140a3ae1fd9e7 (127.11.93.129:43999)
I20260809 02:21:46.535737 25356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2853b855ac40929f94cf7c505dc28c" candidate_uuid: "aa274774174e4f98b92460bf67d80c76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1ee03bec06e4ef7881140a3ae1fd9e7" is_pre_election: true
I20260809 02:21:46.535838 25510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2853b855ac40929f94cf7c505dc28c" candidate_uuid: "aa274774174e4f98b92460bf67d80c76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a8eaace933c49e0b2e8369ef4dec122"
I20260809 02:21:46.535848 25352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2853b855ac40929f94cf7c505dc28c" candidate_uuid: "aa274774174e4f98b92460bf67d80c76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1ee03bec06e4ef7881140a3ae1fd9e7"
I20260809 02:21:46.535905 25356 raft_consensus.cc:2454] T 8e2853b855ac40929f94cf7c505dc28c P c1ee03bec06e4ef7881140a3ae1fd9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa274774174e4f98b92460bf67d80c76 in term 0.
I20260809 02:21:46.535907 25510 raft_consensus.cc:3037] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:46.536700 25510 raft_consensus.cc:2454] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa274774174e4f98b92460bf67d80c76 in term 1.
I20260809 02:21:46.537019 25584 leader_election.cc:302] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a8eaace933c49e0b2e8369ef4dec122, aa274774174e4f98b92460bf67d80c76; no voters: c1ee03bec06e4ef7881140a3ae1fd9e7
I20260809 02:21:46.537118 25746 raft_consensus.cc:2781] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:46.537281 25746 raft_consensus.cc:686] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76 [term 1 LEADER]: Becoming Leader. State: Replica: aa274774174e4f98b92460bf67d80c76, State: Running, Role: LEADER
I20260809 02:21:46.537360 25746 consensus_queue.cc:237] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8eaace933c49e0b2e8369ef4dec122" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 39745 } } peers { permanent_uuid: "c1ee03bec06e4ef7881140a3ae1fd9e7" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43999 } } peers { permanent_uuid: "aa274774174e4f98b92460bf67d80c76" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 40169 } }
I20260809 02:21:46.538158 25211 catalog_manager.cc:5495] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa274774174e4f98b92460bf67d80c76 (127.11.93.131). New cstate: current_term: 1 leader_uuid: "aa274774174e4f98b92460bf67d80c76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a8eaace933c49e0b2e8369ef4dec122" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 39745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1ee03bec06e4ef7881140a3ae1fd9e7" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa274774174e4f98b92460bf67d80c76" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 40169 } health_report { overall_health: HEALTHY } } }
I20260809 02:21:46.545857 25736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:46.542596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39160 (local address 127.11.93.131:40169)
0809 02:21:46.542631 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:46.542633 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:46.542662 (+ 29us) server_negotiation.cc:407] Connection header received
0809 02:21:46.542763 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:46.542764 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:46.542781 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:46.542854 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:21:46.543048 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.543742 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.544920 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:46.545230 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:46.545303 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:46.545508 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:21:46.545616 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:21:46.545699 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:46.545766 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 02:21:46.545785 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 02:21:46.547946 25352 raft_consensus.cc:3037] T 8e2853b855ac40929f94cf7c505dc28c P c1ee03bec06e4ef7881140a3ae1fd9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:46.548060 25510 raft_consensus.cc:1261] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122 [term 1 FOLLOWER]: Refusing update from remote peer aa274774174e4f98b92460bf67d80c76: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:46.548394 25750 consensus_queue.cc:1035] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a8eaace933c49e0b2e8369ef4dec122" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 39745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:46.548893 25352 raft_consensus.cc:1261] T 8e2853b855ac40929f94cf7c505dc28c P c1ee03bec06e4ef7881140a3ae1fd9e7 [term 1 FOLLOWER]: Refusing update from remote peer aa274774174e4f98b92460bf67d80c76: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:46.549147 25750 consensus_queue.cc:1035] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1ee03bec06e4ef7881140a3ae1fd9e7" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:46.553819 25756 mvcc.cc:205] Tried to move back new op lower bound from 7316447668417925120 to 7316447668377489408. Current Snapshot: MvccSnapshot[applied={T|T < 7316447668417925120}]
I20260809 02:21:46.554713 25211 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52310:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:46.554796 25211 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52310:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:46.555568 25211 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f04a74f5a14c4449a802b2aec6ad1fb5: Sending DeleteTablet for 3 replicas of tablet 8e2853b855ac40929f94cf7c505dc28c
I20260809 02:21:46.556061 25489 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e2853b855ac40929f94cf7c505dc28c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:46 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:60916
I20260809 02:21:46.556284 25341 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e2853b855ac40929f94cf7c505dc28c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:46 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:37518
I20260809 02:21:46.556486 25623 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e2853b855ac40929f94cf7c505dc28c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:46 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:39148
I20260809 02:21:46.557174 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 25251
I20260809 02:21:46.560606 25762 tablet_replica.cc:330] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122: stopping tablet replica
I20260809 02:21:46.564636 25764 tablet_replica.cc:330] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76: stopping tablet replica
W20260809 02:21:46.565235 25584 consensus_peers.cc:487] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76 -> Peer 0a8eaace933c49e0b2e8369ef4dec122 (127.11.93.130:39745): Couldn't send request to peer 0a8eaace933c49e0b2e8369ef4dec122. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260809 02:21:46.565447 25764 raft_consensus.cc:2229] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:21:46.565586 25762 raft_consensus.cc:2229] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:21:46.565761 25764 raft_consensus.cc:2258] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:46.565876 25762 pending_rounds.cc:62] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122: Trying to abort 2 pending ops.
I20260809 02:21:46.565946 25762 pending_rounds.cc:68] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7316447668417925120 op_type: WRITE_OP write_request { tablet_id: "8e2853b855ac40929f94cf7c505dc28c" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "val" type: INT32 is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\003\00090\000\0001\324\000\000" indirect_data: "<redacted>""" } external_consistency_mode: CLIENT_PROPAGATED authz_token { token_data: "\010\346\312\337\323\006\"8\n\ntest-admin\022*\n 42df60a34a994a4093ebdffe408fbc78\020\001\030\001 \001(\001" signature: "<redacted>""c\034\374\375\340C\244\345\345\031\037^\031#\350\2315\266.\020se\274n\013\377X\242\031z\217\371\211\310%\340Mxz@\260\361\234\n\331\206\374\311f\200O\021\223~`\364\341\234\342\275\251\240;@" signing_key_seq_num: 0 } } request_id { client_id: "98e636d9d38948fd996a85f67db20594" seq_no: 0 first_incomplete_seq_no: 0 attempt_no: 0 }
I20260809 02:21:46.566356 25762 pending_rounds.cc:68] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316447668377489408 op_type: NO_OP noop_request { }
I20260809 02:21:46.566476 25762 raft_consensus.cc:2866] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260809 02:21:46.566545 25762 raft_consensus.cc:2258] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:46.567039 25762 ts_tablet_manager.cc:1905] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 02:21:46.568740 25196 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.93.129:43999 (error 108)
I20260809 02:21:46.569087 25762 ts_tablet_manager.cc:1918] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:46.569217 25762 log.cc:1196] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/8e2853b855ac40929f94cf7c505dc28c
I20260809 02:21:46.569528 25762 ts_tablet_manager.cc:1939] T 8e2853b855ac40929f94cf7c505dc28c P 0a8eaace933c49e0b2e8369ef4dec122: Deleting consensus metadata
I20260809 02:21:46.570003 25196 catalog_manager.cc:4841] TS 0a8eaace933c49e0b2e8369ef4dec122 (127.11.93.130:39745): tablet 8e2853b855ac40929f94cf7c505dc28c (table test-table [id=42df60a34a994a4093ebdffe408fbc78]) successfully deleted
I20260809 02:21:46.570528 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 25421
I20260809 02:21:46.574359 25764 ts_tablet_manager.cc:1905] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:46.575368 25734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:46.575247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:43999 (local address 127.0.0.1:37528)
0809 02:21:46.575301 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:46.575335 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.129:43999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260809 02:21:46.575537 25196 catalog_manager.cc:4584] TS c1ee03bec06e4ef7881140a3ae1fd9e7 (127.11.93.129:43999): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8e2853b855ac40929f94cf7c505dc28c: Network error: Client connection negotiation failed: client connection to 127.11.93.129:43999: connect: Connection refused (error 111)
I20260809 02:21:46.580821 25764 ts_tablet_manager.cc:1918] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:46.580976 25764 log.cc:1196] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/8e2853b855ac40929f94cf7c505dc28c
I20260809 02:21:46.581372 25764 ts_tablet_manager.cc:1939] T 8e2853b855ac40929f94cf7c505dc28c P aa274774174e4f98b92460bf67d80c76: Deleting consensus metadata
I20260809 02:21:46.581831 25196 catalog_manager.cc:4841] TS aa274774174e4f98b92460bf67d80c76 (127.11.93.131:40169): tablet 8e2853b855ac40929f94cf7c505dc28c (table test-table [id=42df60a34a994a4093ebdffe408fbc78]) successfully deleted
I20260809 02:21:46.582494 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 25563
I20260809 02:21:46.588057 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 25175
I20260809 02:21:46.595327 11638 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 02:21:46.940551 11638 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 02:21:46.940650 11638 mini_ranger.cc:66] Stopping Ranger...
I20260809 02:21:47.285465 11638 mini_ranger.cc:68] Stopped Ranger
2026-08-09 02:21:47.285 UTC [24183] LOG: received smart shutdown request
2026-08-09 02:21:47.290 UTC [24183] LOG: background worker "logical replication launcher" (PID 24192) exited with exit code 1
2026-08-09 02:21:47.290 UTC [24187] LOG: shutting down
2026-08-09 02:21:47.472 UTC [24183] LOG: database system is shut down
2026-08-09T02:21:47Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (50020 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:21:47 dist-test-slave-w206 krb5kdc[25775](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:21:47 dist-test-slave-w206 krb5kdc[25775](info): set up 2 sockets
Aug 09 02:21:47 dist-test-slave-w206 krb5kdc[25775](info): commencing operation
krb5kdc: starting...
W20260809 02:21:48.674314 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:21:48 dist-test-slave-w206 krb5kdc[25775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242108, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:21:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:21:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:21:48.797698 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:38799
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:41999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:38799,127.11.93.189:38361,127.11.93.188:43885
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:48.879415 25791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:48.879657 25791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:48.879693 25791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:48.880847 25791 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:48.880924 25791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:48.880949 25791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:48.880970 25791 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:48.880999 25791 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:21:48.882521 25791 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:41999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:38799,127.11.93.189:38361,127.11.93.188:43885
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:38799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:48.882802 25791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:48.883054 25791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:48.887825 25799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:48.887892 25796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:48.887846 25797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:48.888092 25791 server_base.cc:1034] running on GCE node
I20260809 02:21:48.888435 25791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:48.888669 25791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:48.889804 25791 hybrid_clock.cc:648] HybridClock initialized: now 1786242108889795 us; error 27 us; skew 500 ppm
Aug 09 02:21:48 dist-test-slave-w206 krb5kdc[25775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242108, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:48.892396 25791 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:21:48.892835 25791 webserver.cc:460] Webserver started at http://127.11.93.190:35083/ using document root <none> and password file <none>
I20260809 02:21:48.893081 25791 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:48.893127 25791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:48.893291 25791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:48.894325 25791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "024a6edcd2314db79e5d0f3a390ae618"
format_stamp: "Formatted at 2026-08-09 02:21:48 on dist-test-slave-w206"
server_key: "a62435a799cde2eabf79e544bdfff23b"
server_key_iv: "b99e53b6c2745984ab9efabddae2b528"
server_key_version: "encryptionkey@0"
I20260809 02:21:48.894694 25791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "024a6edcd2314db79e5d0f3a390ae618"
format_stamp: "Formatted at 2026-08-09 02:21:48 on dist-test-slave-w206"
server_key: "a62435a799cde2eabf79e544bdfff23b"
server_key_iv: "b99e53b6c2745984ab9efabddae2b528"
server_key_version: "encryptionkey@0"
I20260809 02:21:48.896179 25791 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260809 02:21:48.896893 25806 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:48.897073 25791 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:21:48.897173 25791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "024a6edcd2314db79e5d0f3a390ae618"
format_stamp: "Formatted at 2026-08-09 02:21:48 on dist-test-slave-w206"
server_key: "a62435a799cde2eabf79e544bdfff23b"
server_key_iv: "b99e53b6c2745984ab9efabddae2b528"
server_key_version: "encryptionkey@0"
I20260809 02:21:48.897256 25791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:48.919646 25791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:48.921557 25791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:48.921734 25791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:48.926024 25791 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:38799
I20260809 02:21:48.926064 25860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:38799 every 8 connection(s)
I20260809 02:21:48.926414 25791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:21:48.927352 25861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:48.928934 25861 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38799 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:21:48.932869 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 25791
I20260809 02:21:48.932991 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:21:48.933187 11638 external_mini_cluster.cc:1428] Setting key 8c0e1f8db3e7c8c09553cf6e97d5d811
Aug 09 02:21:48 dist-test-slave-w206 krb5kdc[25775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242108, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:21:48.940351 25864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:48.929649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48742 (local address 127.11.93.190:38799)
0809 02:21:48.929832 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:48.929841 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:48.929971 (+ 130us) server_negotiation.cc:407] Connection header received
0809 02:21:48.930544 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:48.930546 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:48.930571 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:48.930670 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:48.931265 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:48.932082 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:48.933217 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:48.933648 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:48.933772 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:48.936736 (+ 2964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:48.936743 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:48.936744 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:48.936750 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:48.938544 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:48.939150 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:48.939152 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:48.939152 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:48.939230 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:48.939540 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:48.939541 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:48.939541 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:48.939739 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:48.939798 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:48.940096 (+ 298us) server_negotiation.cc:299] Negotiation successful
0809 02:21:48.940196 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":86,"threads_started":1}
I20260809 02:21:48.940567 25863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:48.929630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:38799 (local address 127.0.0.1:48742)
0809 02:21:48.929823 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:48.929866 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:48.930365 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:48.930676 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:48.930678 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:48.930953 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:48.931151 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:48.931155 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:48.932183 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:48.932184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:48.933087 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:48.933091 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:48.933758 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:48.933760 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:48.933853 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:48.934417 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:48.934427 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:48.936594 (+ 2167us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:48.938644 (+ 2050us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:48.938663 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:48.938665 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:48.939045 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:48.939312 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:48.939314 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:48.939315 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:48.939456 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:48.939819 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:48.939827 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:48.939938 (+ 111us) client_negotiation.cc:769] Sending connection context
0809 02:21:48.940059 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 02:21:48.940326 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"mutex_wait_us":65,"thread_start_us":86,"threads_started":1}
I20260809 02:21:48.941368 25861 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:21:48.941797 25863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:48.941626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:38361 (local address 127.0.0.1:39646)
0809 02:21:48.941693 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:48.941758 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.189:38361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 02:21:48.941977 25810 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.93.189:38361: connect: Connection refused (error 111)
I20260809 02:21:48.942430 25863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:48.942301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:38361 (local address 127.0.0.1:39652)
0809 02:21:48.942359 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:48.942395 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.189:38361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260809 02:21:48.942567 25861 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.189:38361: Network error: Client connection negotiation failed: client connection to 127.11.93.189:38361: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.11.93.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.189.keytab.
Entry for principal kudu/127.11.93.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.189.keytab.
I20260809 02:21:48.962376 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.189:38361
--webserver_interface=127.11.93.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.189.keytab
--principal=kudu/127.11.93.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:41999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:38799,127.11.93.189:38361,127.11.93.188:43885
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:21:48.991822 25861 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } attempt: 1
I20260809 02:21:48.992353 25863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:48.992182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:38361 (local address 127.0.0.1:39654)
0809 02:21:48.992259 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:48.992311 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.189:38361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 02:21:48.992762 25863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:48.992647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:38361 (local address 127.0.0.1:39660)
0809 02:21:48.992692 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:48.992743 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.189:38361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260809 02:21:48.992913 25861 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.189:38361: Network error: Client connection negotiation failed: client connection to 127.11.93.189:38361: connect: Connection refused (error 111)
W20260809 02:21:49.045003 25868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:49.045222 25868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:49.045245 25868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:49.046424 25868 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:49.046474 25868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:49.046489 25868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:49.046502 25868 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:49.046559 25868 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:21:49.048173 25868 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:41999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:38799,127.11.93.189:38361,127.11.93.188:43885
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.189.keytab
--principal=kudu/127.11.93.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.189:38361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.93.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25868
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:49.048453 25868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:49.048704 25868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:49.053764 25877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:49.053766 25873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:49.053817 25868 server_base.cc:1034] running on GCE node
W20260809 02:21:49.053764 25874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:49.054255 25868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:49.054579 25868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:49.055747 25868 hybrid_clock.cc:648] HybridClock initialized: now 1786242109055722 us; error 36 us; skew 500 ppm
Aug 09 02:21:49 dist-test-slave-w206 krb5kdc[25775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242109, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:49.058450 25868 init.cc:377] Logged in from keytab as kudu/127.11.93.189@KRBTEST.COM (short username kudu)
I20260809 02:21:49.058840 25868 webserver.cc:460] Webserver started at http://127.11.93.189:43415/ using document root <none> and password file <none>
I20260809 02:21:49.059116 25868 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:49.059165 25868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:49.059263 25868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:49.060323 25868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-1/data/instance:
uuid: "c7e37a0c27ac48e9a96de81b30345f57"
format_stamp: "Formatted at 2026-08-09 02:21:49 on dist-test-slave-w206"
server_key: "c53d18ac3e23aed10cafb73678e9e5a4"
server_key_iv: "1ed726b298e31821c4daafacaf4133e7"
server_key_version: "encryptionkey@0"
I20260809 02:21:49.060616 25868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-1/wal/instance:
uuid: "c7e37a0c27ac48e9a96de81b30345f57"
format_stamp: "Formatted at 2026-08-09 02:21:49 on dist-test-slave-w206"
server_key: "c53d18ac3e23aed10cafb73678e9e5a4"
server_key_iv: "1ed726b298e31821c4daafacaf4133e7"
server_key_version: "encryptionkey@0"
I20260809 02:21:49.061077 25861 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } attempt: 2
I20260809 02:21:49.061488 25863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.061336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:38361 (local address 127.0.0.1:39662)
0809 02:21:49.061407 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:49.061447 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.189:38361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 02:21:49.061852 25863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.061731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:38361 (local address 127.0.0.1:39676)
0809 02:21:49.061793 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:49.061824 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.189:38361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 02:21:49.061967 25861 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.189:38361: Network error: Client connection negotiation failed: client connection to 127.11.93.189:38361: connect: Connection refused (error 111)
I20260809 02:21:49.062168 25868 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:21:49.062945 25885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:49.063128 25868 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:21:49.063230 25868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-1/wal
uuid: "c7e37a0c27ac48e9a96de81b30345f57"
format_stamp: "Formatted at 2026-08-09 02:21:49 on dist-test-slave-w206"
server_key: "c53d18ac3e23aed10cafb73678e9e5a4"
server_key_iv: "1ed726b298e31821c4daafacaf4133e7"
server_key_version: "encryptionkey@0"
I20260809 02:21:49.063319 25868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:49.084935 25868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:49.086875 25868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:49.087077 25868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:49.091706 25868 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.189:38361
I20260809 02:21:49.091734 25941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.189:38361 every 8 connection(s)
I20260809 02:21:49.092094 25868 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-1/data/info.pb
I20260809 02:21:49.092950 25942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:49.094509 25942 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38799 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:21:49.098340 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 25868
I20260809 02:21:49.098464 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-1/wal/instance
I20260809 02:21:49.098662 11638 external_mini_cluster.cc:1428] Setting key ef173286140984fb26859d1c52c3cf8e
Aug 09 02:21:49 dist-test-slave-w206 krb5kdc[25775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242109, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.189@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:21:49.104853 25864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.095316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48752 (local address 127.11.93.190:38799)
0809 02:21:49.095378 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:49.095379 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:49.095596 (+ 217us) server_negotiation.cc:407] Connection header received
0809 02:21:49.096106 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:49.096108 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:49.096122 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:49.096189 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:49.096806 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.097316 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.098476 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.098765 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.098826 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:49.101523 (+ 2697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:49.101525 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:49.101525 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:49.101532 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:49.103303 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.103799 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.103801 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.103802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.103877 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.104119 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.104120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.104121 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.104286 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:49.104372 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:49.104606 (+ 234us) server_negotiation.cc:299] Negotiation successful
0809 02:21:49.104712 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 02:21:49.104931 25944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.095288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:38799 (local address 127.0.0.1:48752)
0809 02:21:49.095476 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:49.095511 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:49.095998 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:49.096261 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:49.096264 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:49.096513 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:49.096707 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:49.096711 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.097428 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.097429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:49.098370 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:49.098374 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.098839 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.098841 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:49.099037 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:49.099576 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:49.099587 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:49.101411 (+ 1824us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:49.103406 (+ 1995us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:49.103413 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:49.103414 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:49.103715 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:49.103947 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:49.103948 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:49.103948 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:49.104051 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:49.104354 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:49.104359 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:49.104473 (+ 114us) client_negotiation.cc:769] Sending connection context
0809 02:21:49.104555 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 02:21:49.104674 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":93,"threads_started":1}
I20260809 02:21:49.105559 25942 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.93.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.188@KRBTEST.COM" created.
Aug 09 02:21:49 dist-test-slave-w206 krb5kdc[25775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242109, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.189@KRBTEST.COM for kudu/127.11.93.189@KRBTEST.COM
I20260809 02:21:49.114799 25944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.105856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:38361 (local address 127.0.0.1:39690)
0809 02:21:49.106084 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:49.106096 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:49.106149 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:49.106278 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:49.106278 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:49.106445 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:49.106505 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:49.106507 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.107388 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.107389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:49.108224 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:49.108227 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.108734 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.108735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:49.108791 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:49.109191 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:49.109195 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:49.111534 (+ 2339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:49.113608 (+ 2074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:49.113609 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:49.113609 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:49.113770 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:49.113996 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:49.113997 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:49.113997 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:49.114071 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:49.114358 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:49.114359 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:49.114409 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 02:21:49.114485 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 02:21:49.114592 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212}
I20260809 02:21:49.114807 25946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.105927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39690 (local address 127.11.93.189:38361)
0809 02:21:49.106075 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:49.106079 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:49.106142 (+ 63us) server_negotiation.cc:407] Connection header received
0809 02:21:49.106203 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:49.106205 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:49.106216 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:49.106274 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:49.106578 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.107292 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.108310 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.108658 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.108719 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:49.111626 (+ 2907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:49.111635 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:49.111636 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:49.111642 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:49.113516 (+ 1874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.113856 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.113859 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.113859 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.113925 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.114136 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.114137 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.114137 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.114281 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:49.114346 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:49.114594 (+ 248us) server_negotiation.cc:299] Negotiation successful
0809 02:21:49.114667 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":101,"threads_started":1}
I20260809 02:21:49.115687 25942 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:21:49.116053 25944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.115920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43885 (local address 127.0.0.1:52240)
0809 02:21:49.115972 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:49.116026 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 02:21:49.116215 25888 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43885: connect: Connection refused (error 111)
I20260809 02:21:49.116700 25944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.116602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43885 (local address 127.0.0.1:52248)
0809 02:21:49.116656 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:49.116682 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 02:21:49.116844 25942 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.188:43885: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43885: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.188.keytab.
Entry for principal kudu/127.11.93.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.188.keytab.
I20260809 02:21:49.127513 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.188:43885
--webserver_interface=127.11.93.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.188.keytab
--principal=kudu/127.11.93.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:41999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:38799,127.11.93.189:38361,127.11.93.188:43885
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:21:49.153133 25861 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } attempt: 3
Aug 09 02:21:49 dist-test-slave-w206 krb5kdc[25775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242108, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for kudu/127.11.93.189@KRBTEST.COM
I20260809 02:21:49.161007 25863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.153560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:38361 (local address 127.0.0.1:39696)
0809 02:21:49.153627 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:49.153639 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:49.153683 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:49.153856 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:49.153857 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:49.154056 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:49.154135 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:49.154137 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.154816 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.154817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:49.155655 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:49.155658 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.156051 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.156053 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:49.156165 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:49.156647 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:49.156655 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:49.158137 (+ 1482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:49.159883 (+ 1746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:49.159884 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:49.159884 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:49.160154 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:49.160352 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:49.160353 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:49.160354 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:49.160429 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:49.160664 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:49.160665 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:49.160718 (+ 53us) client_negotiation.cc:769] Sending connection context
0809 02:21:49.160789 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 02:21:49.160903 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 02:21:49.161021 25946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.153623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39696 (local address 127.11.93.189:38361)
0809 02:21:49.153685 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:49.153688 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:49.153738 (+ 50us) server_negotiation.cc:407] Connection header received
0809 02:21:49.153765 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:49.153766 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:49.153775 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:49.153818 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:49.154218 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.154730 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.155742 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.155964 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.156023 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:49.158247 (+ 2224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:49.158248 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:49.158249 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:49.158257 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:49.159790 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.160233 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.160233 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.160234 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.160286 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.160491 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.160492 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.160492 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.160601 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:49.160652 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:49.160866 (+ 214us) server_negotiation.cc:299] Negotiation successful
0809 02:21:49.160952 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 02:21:49.161693 25861 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:21:49.162092 25863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.161975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43885 (local address 127.0.0.1:52258)
0809 02:21:49.162027 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:49.162064 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 02:21:49.162479 25863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.162376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43885 (local address 127.0.0.1:52272)
0809 02:21:49.162431 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:49.162459 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 02:21:49.162596 25861 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.188:43885: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43885: connect: Connection refused (error 111)
I20260809 02:21:49.166051 25942 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } attempt: 1
I20260809 02:21:49.166421 25944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.166295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43885 (local address 127.0.0.1:52280)
0809 02:21:49.166350 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:49.166380 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 02:21:49.166750 25944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.166632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43885 (local address 127.0.0.1:52288)
0809 02:21:49.166695 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:49.166724 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 02:21:49.166839 25942 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.188:43885: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43885: connect: Connection refused (error 111)
I20260809 02:21:49.193761 25861 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } attempt: 1
I20260809 02:21:49.194267 25863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.194126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43885 (local address 127.0.0.1:52302)
0809 02:21:49.194197 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:49.194237 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 02:21:49.194628 25863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.194528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43885 (local address 127.0.0.1:52306)
0809 02:21:49.194575 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:49.194600 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 02:21:49.194720 25861 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.188:43885: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43885: connect: Connection refused (error 111)
W20260809 02:21:49.213403 25949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:49.213604 25949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:49.213626 25949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:49.214787 25949 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:49.214830 25949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:49.214845 25949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:49.214861 25949 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:49.214913 25949 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:21:49.216504 25949 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:41999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:38799,127.11.93.189:38361,127.11.93.188:43885
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.188.keytab
--principal=kudu/127.11.93.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.188:43885
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.93.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:49.216773 25949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:49.217024 25949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:49.221939 25956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:49.221920 25954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:49.222000 25958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:49.222121 25949 server_base.cc:1034] running on GCE node
I20260809 02:21:49.222484 25949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:49.222826 25949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:49.223984 25949 hybrid_clock.cc:648] HybridClock initialized: now 1786242109223936 us; error 59 us; skew 500 ppm
Aug 09 02:21:49 dist-test-slave-w206 krb5kdc[25775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242109, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:49.226400 25949 init.cc:377] Logged in from keytab as kudu/127.11.93.188@KRBTEST.COM (short username kudu)
I20260809 02:21:49.226825 25949 webserver.cc:460] Webserver started at http://127.11.93.188:35409/ using document root <none> and password file <none>
I20260809 02:21:49.227115 25949 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:49.227185 25949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:49.227344 25949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:49.228408 25949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-2/data/instance:
uuid: "47c84f69ac144bb6b205efb2d31c830c"
format_stamp: "Formatted at 2026-08-09 02:21:49 on dist-test-slave-w206"
server_key: "7de6215051714a8745f39b0ad5cd2749"
server_key_iv: "bfe03d9e296c0ae345b10d3bdb9b42ca"
server_key_version: "encryptionkey@0"
I20260809 02:21:49.228781 25949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-2/wal/instance:
uuid: "47c84f69ac144bb6b205efb2d31c830c"
format_stamp: "Formatted at 2026-08-09 02:21:49 on dist-test-slave-w206"
server_key: "7de6215051714a8745f39b0ad5cd2749"
server_key_iv: "bfe03d9e296c0ae345b10d3bdb9b42ca"
server_key_version: "encryptionkey@0"
I20260809 02:21:49.230127 25949 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:21:49.230837 25966 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:49.231079 25949 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:21:49.231179 25949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-2/wal
uuid: "47c84f69ac144bb6b205efb2d31c830c"
format_stamp: "Formatted at 2026-08-09 02:21:49 on dist-test-slave-w206"
server_key: "7de6215051714a8745f39b0ad5cd2749"
server_key_iv: "bfe03d9e296c0ae345b10d3bdb9b42ca"
server_key_version: "encryptionkey@0"
I20260809 02:21:49.231285 25949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:49.234997 25942 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } attempt: 2
I20260809 02:21:49.235381 25944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.235254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43885 (local address 127.0.0.1:52310)
0809 02:21:49.235311 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:49.235348 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 02:21:49.235733 25944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.235655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43885 (local address 127.0.0.1:52312)
0809 02:21:49.235694 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:49.235717 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43885: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260809 02:21:49.235836 25942 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.188:43885: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43885: connect: Connection refused (error 111)
I20260809 02:21:49.243393 25949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:49.245329 25949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:49.245479 25949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:49.249629 25949 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.188:43885
I20260809 02:21:49.249686 26020 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.188:43885 every 8 connection(s)
I20260809 02:21:49.250061 25949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-2/data/info.pb
I20260809 02:21:49.250928 26021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:49.252499 26021 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38799 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:21:49.252882 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 25949
I20260809 02:21:49.253019 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786241951749734-11638-0/minicluster-data/master-2/wal/instance
I20260809 02:21:49.253261 11638 external_mini_cluster.cc:1428] Setting key 57cc0b7a7b5b60ad6fd9b120ffe70d63
Aug 09 02:21:49 dist-test-slave-w206 krb5kdc[25775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242109, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.188@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
Aug 09 02:21:49 dist-test-slave-w206 krb5kdc[25775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242108, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.188@KRBTEST.COM
I20260809 02:21:49.262867 25864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.253270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48762 (local address 127.11.93.190:38799)
0809 02:21:49.253348 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:49.253350 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:49.253548 (+ 198us) server_negotiation.cc:407] Connection header received
0809 02:21:49.254222 (+ 674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:49.254223 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:49.254235 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:49.254310 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:49.254851 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.255420 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.256626 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.256920 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.256988 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:49.259206 (+ 2218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:49.259208 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:49.259208 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:49.259215 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:49.261545 (+ 2330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.261941 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.261942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.261943 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.262011 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.262243 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.262244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.262245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.262369 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:49.262448 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:49.262688 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 02:21:49.262775 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:21:49.263136 26023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.253250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:38799 (local address 127.0.0.1:48762)
0809 02:21:49.253403 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:49.253445 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:49.254097 (+ 652us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:49.254360 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:49.254363 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:49.254615 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:49.254759 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:49.254762 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.255499 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.255500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:49.256546 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:49.256549 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.256995 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.256996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:49.257132 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:49.257676 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:49.257684 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:49.259120 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:49.261636 (+ 2516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:49.261642 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:49.261644 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:49.261838 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:49.262080 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:49.262081 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:49.262082 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:49.262173 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:49.262447 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:49.262455 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:49.262565 (+ 110us) client_negotiation.cc:769] Sending connection context
0809 02:21:49.262665 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 02:21:49.262813 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":27,"thread_start_us":78,"threads_started":1}
I20260809 02:21:49.263139 26025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.253650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52326 (local address 127.11.93.188:43885)
0809 02:21:49.253985 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:49.253989 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:49.254023 (+ 34us) server_negotiation.cc:407] Connection header received
0809 02:21:49.254108 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:49.254115 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:49.254137 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:49.254223 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:49.254913 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.256019 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.256939 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.257372 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.257442 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:49.259828 (+ 2386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:49.259836 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:49.259836 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:49.259844 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:49.261696 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.262049 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.262052 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.262053 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.262145 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.262357 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.262357 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.262358 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.262567 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:49.262718 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:49.262804 (+ 86us) server_negotiation.cc:299] Negotiation successful
0809 02:21:49.262884 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":89,"threads_started":1}
I20260809 02:21:49.263742 26021 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:21:49 dist-test-slave-w206 krb5kdc[25775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242109, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.188@KRBTEST.COM for kudu/127.11.93.189@KRBTEST.COM
Aug 09 02:21:49 dist-test-slave-w206 krb5kdc[25775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242108, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:21:49.269865 25861 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } attempt: 2
I20260809 02:21:49.271581 26023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.263994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:38361 (local address 127.0.0.1:39710)
0809 02:21:49.264078 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:49.264089 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:49.264241 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:49.264372 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:49.264372 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:49.264531 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:49.264590 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:49.264592 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.265420 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.265421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:49.266147 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:49.266149 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.266516 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.266516 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:49.266568 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:49.267001 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:49.267007 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:49.268390 (+ 1383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:49.270436 (+ 2046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:49.270437 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:49.270437 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:49.270643 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:49.270874 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:49.270875 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:49.270875 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:49.270941 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:49.271215 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:49.271216 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:49.271260 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 02:21:49.271357 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 02:21:49.271464 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 02:21:49.271610 25946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.264100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39710 (local address 127.11.93.189:38361)
0809 02:21:49.264188 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:49.264190 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:49.264248 (+ 58us) server_negotiation.cc:407] Connection header received
0809 02:21:49.264301 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:49.264302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:49.264313 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:49.264360 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:49.264667 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.265344 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.266230 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.266419 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.266502 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:49.268480 (+ 1978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:49.268482 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:49.268482 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:49.268491 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:49.270300 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.270736 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.270737 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.270737 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.270797 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.271024 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.271025 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.271026 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.271145 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:49.271223 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:49.271434 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 02:21:49.271520 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 02:21:49.272159 25864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.264130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48772 (local address 127.11.93.190:38799)
0809 02:21:49.264167 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:49.264169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:49.264177 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:21:49.264263 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:49.264264 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:49.264275 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:49.264339 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:49.264875 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.265532 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.266465 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.266678 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.266755 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:49.269096 (+ 2341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:49.269097 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:49.269098 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:49.269104 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:49.270933 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.271326 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.271327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.271327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.271387 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.271595 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.271596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.271596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.271735 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:49.271931 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:49.271973 (+ 42us) server_negotiation.cc:299] Negotiation successful
0809 02:21:49.272049 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 02:21:49.272539 26021 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:21:49 dist-test-slave-w206 krb5kdc[25775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242108, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for kudu/127.11.93.188@KRBTEST.COM
Aug 09 02:21:49 dist-test-slave-w206 krb5kdc[25775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242108, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.189@KRBTEST.COM
Aug 09 02:21:49 dist-test-slave-w206 krb5kdc[25775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242109, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.188@KRBTEST.COM for kudu/127.11.93.188@KRBTEST.COM
I20260809 02:21:49.278721 26025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.270191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52328 (local address 127.11.93.188:43885)
0809 02:21:49.270246 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:49.270248 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:49.270255 (+ 7us) server_negotiation.cc:407] Connection header received
0809 02:21:49.270275 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:49.270276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:49.270287 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:49.270340 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:49.270703 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.271447 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.272410 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.272717 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.272796 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:49.274737 (+ 1941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:49.274738 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:49.274738 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:49.274746 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:49.277237 (+ 2491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.277641 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.277642 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.277643 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.277698 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.277923 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.277924 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.277924 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.278051 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:49.278151 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:49.278531 (+ 380us) server_negotiation.cc:299] Negotiation successful
0809 02:21:49.278630 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 02:21:49.279156 25863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.270125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43885 (local address 127.0.0.1:52328)
0809 02:21:49.270171 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:49.270180 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:49.270218 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:49.270366 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:49.270367 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:49.270568 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:49.270612 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:49.270614 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.271540 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.271541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:49.272308 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:49.272311 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.272807 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.272808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:49.272864 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:49.273252 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:49.273256 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:49.274653 (+ 1397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:49.277321 (+ 2668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:49.277322 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:49.277323 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:49.277566 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:49.277774 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:49.277775 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:49.277775 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:49.277834 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:49.278352 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:49.278353 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:49.278420 (+ 67us) client_negotiation.cc:769] Sending connection context
0809 02:21:49.278500 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 02:21:49.278595 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 02:21:49.280730 25946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.272923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39712 (local address 127.11.93.189:38361)
0809 02:21:49.273022 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:49.273024 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:49.273031 (+ 7us) server_negotiation.cc:407] Connection header received
0809 02:21:49.273051 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:49.273052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:49.273060 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:49.273115 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:49.273549 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.274155 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.275110 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.275368 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.275469 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:49.277931 (+ 2462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:49.277933 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:49.277933 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:49.277940 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:49.279547 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.279858 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.279859 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.279860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.279955 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.280168 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.280170 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.280170 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.280309 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:49.280514 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:49.280554 (+ 40us) server_negotiation.cc:299] Negotiation successful
0809 02:21:49.280632 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 02:21:49.281330 25861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 024a6edcd2314db79e5d0f3a390ae618: Bootstrap starting.
I20260809 02:21:49.281814 26023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.272783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43885 (local address 127.0.0.1:52332)
0809 02:21:49.272968 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:49.272977 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:49.273009 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:49.273839 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:49.273840 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:49.273973 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:49.274008 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:49.274010 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.274782 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.274783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:49.275511 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:49.275514 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.275991 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.275993 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:49.276054 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:49.276462 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:49.276466 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:49.278334 (+ 1868us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:49.280624 (+ 2290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:49.280625 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:49.280625 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:49.280816 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:49.281118 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:49.281119 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:49.281119 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:49.281174 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:49.281493 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:49.281493 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:49.281530 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 02:21:49.281596 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 02:21:49.281701 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171}
I20260809 02:21:49.282194 25861 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 024a6edcd2314db79e5d0f3a390ae618: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:49.282234 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.272850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52332 (local address 127.11.93.188:43885)
0809 02:21:49.273209 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:49.273211 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:49.273705 (+ 494us) server_negotiation.cc:407] Connection header received
0809 02:21:49.273729 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:49.273730 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:49.273740 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:49.273811 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:49.274109 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.274711 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.275605 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.275910 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.275991 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:49.278430 (+ 2439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:49.278431 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:49.278431 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:49.278438 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:49.280542 (+ 2104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.280893 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.280894 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.280895 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.281065 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.281258 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.281259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.281259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.281410 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:49.281470 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:49.281627 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 02:21:49.282086 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":145,"server-negotiator.queue_time_us":339,"thread_start_us":92,"threads_started":1}
I20260809 02:21:49.282488 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:21:49.282548 25861 log.cc:824] T 00000000000000000000000000000000 P 024a6edcd2314db79e5d0f3a390ae618: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:49.283354 25861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 024a6edcd2314db79e5d0f3a390ae618: No bootstrap required, opened a new log
I20260809 02:21:49.283936 26021 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c: Bootstrap starting.
I20260809 02:21:49.284675 26021 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:49.285035 26021 log.cc:824] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:49.285876 25861 raft_consensus.cc:348] T 00000000000000000000000000000000 P 024a6edcd2314db79e5d0f3a390ae618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024a6edcd2314db79e5d0f3a390ae618" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38799 } } peers { permanent_uuid: "c7e37a0c27ac48e9a96de81b30345f57" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } } peers { permanent_uuid: "47c84f69ac144bb6b205efb2d31c830c" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } }
I20260809 02:21:49.286016 25861 raft_consensus.cc:374] T 00000000000000000000000000000000 P 024a6edcd2314db79e5d0f3a390ae618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:49.286048 25861 raft_consensus.cc:729] T 00000000000000000000000000000000 P 024a6edcd2314db79e5d0f3a390ae618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024a6edcd2314db79e5d0f3a390ae618, State: Initialized, Role: FOLLOWER
I20260809 02:21:49.286150 25861 consensus_queue.cc:260] T 00000000000000000000000000000000 P 024a6edcd2314db79e5d0f3a390ae618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024a6edcd2314db79e5d0f3a390ae618" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38799 } } peers { permanent_uuid: "c7e37a0c27ac48e9a96de81b30345f57" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } } peers { permanent_uuid: "47c84f69ac144bb6b205efb2d31c830c" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } }
I20260809 02:21:49.286433 25861 sys_catalog.cc:564] T 00000000000000000000000000000000 P 024a6edcd2314db79e5d0f3a390ae618 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 02:21:49.288326 26048 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 024a6edcd2314db79e5d0f3a390ae618: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:21:49.288375 26048 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:21:49.289371 25791 master_runner.cc:186] Error getting master registration for 127.11.93.189:38361: OK, instance_id { permanent_uuid: "c7e37a0c27ac48e9a96de81b30345f57" instance_seqno: 1786242109090445 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 02:21:49.291792 25791 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:21:49.292268 26037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 024a6edcd2314db79e5d0f3a390ae618 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024a6edcd2314db79e5d0f3a390ae618" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38799 } } peers { permanent_uuid: "c7e37a0c27ac48e9a96de81b30345f57" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } } peers { permanent_uuid: "47c84f69ac144bb6b205efb2d31c830c" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } } }
I20260809 02:21:49.292358 25946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.284487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39714 (local address 127.11.93.189:38361)
0809 02:21:49.284698 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:49.284700 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:49.284707 (+ 7us) server_negotiation.cc:407] Connection header received
0809 02:21:49.284730 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:49.284731 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:49.284741 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:49.284803 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:49.285520 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.286250 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.287235 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.287532 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.287570 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:49.289196 (+ 1626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:49.289198 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:49.289198 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:49.289205 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:49.290964 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.291421 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.291423 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.291423 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.291490 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.291730 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.291731 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.291731 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.291867 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:49.291940 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:49.292170 (+ 230us) server_negotiation.cc:299] Negotiation successful
0809 02:21:49.292248 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190}
I20260809 02:21:49.293856 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.284626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52338 (local address 127.11.93.188:43885)
0809 02:21:49.284663 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:49.284665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:49.285255 (+ 590us) server_negotiation.cc:407] Connection header received
0809 02:21:49.285354 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:49.285355 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:49.285365 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:49.285417 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:49.286078 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.286773 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.287717 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.288362 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.288410 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:49.290489 (+ 2079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:49.290491 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:49.290491 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:49.290499 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:49.292560 (+ 2061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.293054 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.293055 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.293055 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.293112 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.293336 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.293337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.293338 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.293459 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:49.293565 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:49.293673 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 02:21:49.293747 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 02:21:49.292719 26037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 024a6edcd2314db79e5d0f3a390ae618 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:21:49.296057 26021 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c: No bootstrap required, opened a new log
I20260809 02:21:49.296382 25864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.284154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48776 (local address 127.11.93.190:38799)
0809 02:21:49.284195 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:49.284197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:49.284571 (+ 374us) server_negotiation.cc:407] Connection header received
0809 02:21:49.284656 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:49.284657 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:49.284666 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:49.284695 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:49.285728 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.286384 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.287793 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.288073 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.288123 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:49.293682 (+ 5559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:49.293683 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:49.293684 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:49.293691 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:49.295237 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.295561 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.295562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.295563 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.295621 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.295830 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.295831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.295831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.295947 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:49.296064 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:49.296197 (+ 133us) server_negotiation.cc:299] Negotiation successful
0809 02:21:49.296273 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 02:21:49.298220 26021 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024a6edcd2314db79e5d0f3a390ae618" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38799 } } peers { permanent_uuid: "c7e37a0c27ac48e9a96de81b30345f57" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } } peers { permanent_uuid: "47c84f69ac144bb6b205efb2d31c830c" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } }
I20260809 02:21:49.298372 26021 raft_consensus.cc:374] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:49.298413 26021 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c84f69ac144bb6b205efb2d31c830c, State: Initialized, Role: FOLLOWER
I20260809 02:21:49.298548 26021 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024a6edcd2314db79e5d0f3a390ae618" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38799 } } peers { permanent_uuid: "c7e37a0c27ac48e9a96de81b30345f57" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } } peers { permanent_uuid: "47c84f69ac144bb6b205efb2d31c830c" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } }
I20260809 02:21:49.298862 26050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024a6edcd2314db79e5d0f3a390ae618" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38799 } } peers { permanent_uuid: "c7e37a0c27ac48e9a96de81b30345f57" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } } peers { permanent_uuid: "47c84f69ac144bb6b205efb2d31c830c" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } } }
I20260809 02:21:49.298943 26050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:21:49.299015 26021 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [sys.catalog]: configured and running, proceeding with master startup.
W20260809 02:21:49.301446 26061 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:21:49.301527 26061 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:21:49.302601 25949 master_runner.cc:186] Error getting master registration for 127.11.93.189:38361: OK, instance_id { permanent_uuid: "c7e37a0c27ac48e9a96de81b30345f57" instance_seqno: 1786242109090445 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 02:21:49.304376 25949 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:21:49.327031 25942 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } attempt: 3
Aug 09 02:21:49 dist-test-slave-w206 krb5kdc[25775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242109, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.189@KRBTEST.COM for kudu/127.11.93.188@KRBTEST.COM
I20260809 02:21:49.333961 25944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.327352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43885 (local address 127.0.0.1:52348)
0809 02:21:49.327409 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:49.327426 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:49.327469 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:49.327609 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:49.327610 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:49.327787 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:49.327831 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:49.327833 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.328511 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.328512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:49.329008 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:49.329010 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.329366 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.329367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:49.329446 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:49.329947 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:49.329952 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:49.331227 (+ 1275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:49.332851 (+ 1624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:49.332852 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:49.332852 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:49.333033 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:49.333265 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:49.333266 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:49.333267 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:49.333332 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:49.333620 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:49.333621 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:49.333671 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 02:21:49.333739 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 02:21:49.333855 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 02:21:49.333961 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:49.327436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52348 (local address 127.11.93.188:43885)
0809 02:21:49.327475 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:49.327478 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:49.327503 (+ 25us) server_negotiation.cc:407] Connection header received
0809 02:21:49.327526 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:49.327527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:49.327536 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:49.327603 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:49.327944 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.328427 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.329099 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:49.329283 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:49.329368 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:49.331319 (+ 1951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:49.331321 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:49.331321 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:49.331329 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:49.332744 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.333108 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.333109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.333110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.333171 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:49.333414 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:49.333415 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:49.333416 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:49.333564 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:49.333629 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:49.333775 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 02:21:49.333855 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 02:21:49.336145 25942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7e37a0c27ac48e9a96de81b30345f57: Bootstrap starting.
I20260809 02:21:49.336814 25942 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7e37a0c27ac48e9a96de81b30345f57: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:49.337146 25942 log.cc:824] T 00000000000000000000000000000000 P c7e37a0c27ac48e9a96de81b30345f57: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:49.337939 25942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7e37a0c27ac48e9a96de81b30345f57: No bootstrap required, opened a new log
I20260809 02:21:49.339462 25942 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7e37a0c27ac48e9a96de81b30345f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024a6edcd2314db79e5d0f3a390ae618" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38799 } } peers { permanent_uuid: "c7e37a0c27ac48e9a96de81b30345f57" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } } peers { permanent_uuid: "47c84f69ac144bb6b205efb2d31c830c" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } }
I20260809 02:21:49.339599 25942 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7e37a0c27ac48e9a96de81b30345f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:49.339646 25942 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7e37a0c27ac48e9a96de81b30345f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7e37a0c27ac48e9a96de81b30345f57, State: Initialized, Role: FOLLOWER
I20260809 02:21:49.339777 25942 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7e37a0c27ac48e9a96de81b30345f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024a6edcd2314db79e5d0f3a390ae618" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38799 } } peers { permanent_uuid: "c7e37a0c27ac48e9a96de81b30345f57" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } } peers { permanent_uuid: "47c84f69ac144bb6b205efb2d31c830c" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } }
I20260809 02:21:49.340113 26064 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7e37a0c27ac48e9a96de81b30345f57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024a6edcd2314db79e5d0f3a390ae618" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38799 } } peers { permanent_uuid: "c7e37a0c27ac48e9a96de81b30345f57" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } } peers { permanent_uuid: "47c84f69ac144bb6b205efb2d31c830c" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } } }
I20260809 02:21:49.340183 25942 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7e37a0c27ac48e9a96de81b30345f57 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:49.340258 26064 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7e37a0c27ac48e9a96de81b30345f57 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 02:21:49.342058 26075 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c7e37a0c27ac48e9a96de81b30345f57: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:21:49.342170 26075 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:21:49.344249 25868 master_runner.cc:263] No leader master found from master c7e37a0c27ac48e9a96de81b30345f57
I20260809 02:21:49.344298 25868 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:21:49.359691 26050 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:21:49.359870 26050 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024a6edcd2314db79e5d0f3a390ae618" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38799 } } peers { permanent_uuid: "c7e37a0c27ac48e9a96de81b30345f57" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } } peers { permanent_uuid: "47c84f69ac144bb6b205efb2d31c830c" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } }
I20260809 02:21:49.360139 26050 leader_election.cc:288] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 024a6edcd2314db79e5d0f3a390ae618 (127.11.93.190:38799), c7e37a0c27ac48e9a96de81b30345f57 (127.11.93.189:38361)
I20260809 02:21:49.360679 25904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "47c84f69ac144bb6b205efb2d31c830c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7e37a0c27ac48e9a96de81b30345f57" is_pre_election: true
I20260809 02:21:49.360846 25904 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c7e37a0c27ac48e9a96de81b30345f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c84f69ac144bb6b205efb2d31c830c in term 0.
I20260809 02:21:49.361193 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "47c84f69ac144bb6b205efb2d31c830c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024a6edcd2314db79e5d0f3a390ae618" is_pre_election: true
I20260809 02:21:49.361356 25835 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 024a6edcd2314db79e5d0f3a390ae618 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c84f69ac144bb6b205efb2d31c830c in term 0.
I20260809 02:21:49.361709 25970 leader_election.cc:302] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024a6edcd2314db79e5d0f3a390ae618, 47c84f69ac144bb6b205efb2d31c830c; no voters:
I20260809 02:21:49.362951 26050 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:21:49.363052 26050 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:21:49.363078 26050 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:49.364368 26050 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024a6edcd2314db79e5d0f3a390ae618" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38799 } } peers { permanent_uuid: "c7e37a0c27ac48e9a96de81b30345f57" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } } peers { permanent_uuid: "47c84f69ac144bb6b205efb2d31c830c" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } }
I20260809 02:21:49.364498 26050 leader_election.cc:288] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [CANDIDATE]: Term 1 election: Requested vote from peers 024a6edcd2314db79e5d0f3a390ae618 (127.11.93.190:38799), c7e37a0c27ac48e9a96de81b30345f57 (127.11.93.189:38361)
I20260809 02:21:49.364780 25904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "47c84f69ac144bb6b205efb2d31c830c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7e37a0c27ac48e9a96de81b30345f57"
I20260809 02:21:49.364856 25904 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7e37a0c27ac48e9a96de81b30345f57 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:49.365803 25904 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c7e37a0c27ac48e9a96de81b30345f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c84f69ac144bb6b205efb2d31c830c in term 1.
I20260809 02:21:49.366040 25969 leader_election.cc:302] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c84f69ac144bb6b205efb2d31c830c, c7e37a0c27ac48e9a96de81b30345f57; no voters:
I20260809 02:21:49.366314 25835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "47c84f69ac144bb6b205efb2d31c830c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "024a6edcd2314db79e5d0f3a390ae618"
I20260809 02:21:49.366428 25835 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 024a6edcd2314db79e5d0f3a390ae618 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:49.367338 25835 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 024a6edcd2314db79e5d0f3a390ae618 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c84f69ac144bb6b205efb2d31c830c in term 1.
I20260809 02:21:49.367652 26050 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:49.367830 26050 raft_consensus.cc:686] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [term 1 LEADER]: Becoming Leader. State: Replica: 47c84f69ac144bb6b205efb2d31c830c, State: Running, Role: LEADER
I20260809 02:21:49.367933 26050 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024a6edcd2314db79e5d0f3a390ae618" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38799 } } peers { permanent_uuid: "c7e37a0c27ac48e9a96de81b30345f57" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } } peers { permanent_uuid: "47c84f69ac144bb6b205efb2d31c830c" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } }
I20260809 02:21:49.368314 26050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47c84f69ac144bb6b205efb2d31c830c. Latest consensus state: current_term: 1 leader_uuid: "47c84f69ac144bb6b205efb2d31c830c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024a6edcd2314db79e5d0f3a390ae618" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38799 } } peers { permanent_uuid: "c7e37a0c27ac48e9a96de81b30345f57" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } } peers { permanent_uuid: "47c84f69ac144bb6b205efb2d31c830c" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } } }
I20260809 02:21:49.368378 26050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:49.369191 26080 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:21:49.369449 26080 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:21:49.371030 25904 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c7e37a0c27ac48e9a96de81b30345f57 [term 1 FOLLOWER]: Refusing update from remote peer 47c84f69ac144bb6b205efb2d31c830c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:49.371430 26078 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7e37a0c27ac48e9a96de81b30345f57" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:49.372715 26064 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7e37a0c27ac48e9a96de81b30345f57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47c84f69ac144bb6b205efb2d31c830c. Latest consensus state: current_term: 1 leader_uuid: "47c84f69ac144bb6b205efb2d31c830c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024a6edcd2314db79e5d0f3a390ae618" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38799 } } peers { permanent_uuid: "c7e37a0c27ac48e9a96de81b30345f57" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } } peers { permanent_uuid: "47c84f69ac144bb6b205efb2d31c830c" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } } }
I20260809 02:21:49.372802 26064 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7e37a0c27ac48e9a96de81b30345f57 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:21:49.373245 25835 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 024a6edcd2314db79e5d0f3a390ae618 [term 1 FOLLOWER]: Refusing update from remote peer 47c84f69ac144bb6b205efb2d31c830c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:49.373557 26078 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [LEADER]: Connected to new peer: Peer: permanent_uuid: "024a6edcd2314db79e5d0f3a390ae618" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:49.374732 26037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 024a6edcd2314db79e5d0f3a390ae618 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47c84f69ac144bb6b205efb2d31c830c. Latest consensus state: current_term: 1 leader_uuid: "47c84f69ac144bb6b205efb2d31c830c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024a6edcd2314db79e5d0f3a390ae618" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38799 } } peers { permanent_uuid: "c7e37a0c27ac48e9a96de81b30345f57" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } } peers { permanent_uuid: "47c84f69ac144bb6b205efb2d31c830c" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } } }
I20260809 02:21:49.374828 26037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 024a6edcd2314db79e5d0f3a390ae618 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:21:49.376936 26078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "47c84f69ac144bb6b205efb2d31c830c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024a6edcd2314db79e5d0f3a390ae618" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38799 } } peers { permanent_uuid: "c7e37a0c27ac48e9a96de81b30345f57" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } } peers { permanent_uuid: "47c84f69ac144bb6b205efb2d31c830c" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } } }
I20260809 02:21:49.377023 26078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:49.377586 26064 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7e37a0c27ac48e9a96de81b30345f57 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "47c84f69ac144bb6b205efb2d31c830c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024a6edcd2314db79e5d0f3a390ae618" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38799 } } peers { permanent_uuid: "c7e37a0c27ac48e9a96de81b30345f57" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } } peers { permanent_uuid: "47c84f69ac144bb6b205efb2d31c830c" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } } }
I20260809 02:21:49.377673 26064 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7e37a0c27ac48e9a96de81b30345f57 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:21:49.377923 26081 mvcc.cc:205] Tried to move back new op lower bound from 7316447679981318144 to 7316447679971540992. Current Snapshot: MvccSnapshot[applied={T|T < 7316447679981318144}]
I20260809 02:21:49.378057 26082 mvcc.cc:205] Tried to move back new op lower bound from 7316447679981318144 to 7316447679971540992. Current Snapshot: MvccSnapshot[applied={T|T < 7316447679981318144}]
I20260809 02:21:49.379133 26050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "47c84f69ac144bb6b205efb2d31c830c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024a6edcd2314db79e5d0f3a390ae618" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38799 } } peers { permanent_uuid: "c7e37a0c27ac48e9a96de81b30345f57" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } } peers { permanent_uuid: "47c84f69ac144bb6b205efb2d31c830c" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } } }
I20260809 02:21:49.379209 26050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:49.379660 26037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 024a6edcd2314db79e5d0f3a390ae618 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "47c84f69ac144bb6b205efb2d31c830c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "024a6edcd2314db79e5d0f3a390ae618" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38799 } } peers { permanent_uuid: "c7e37a0c27ac48e9a96de81b30345f57" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 38361 } } peers { permanent_uuid: "47c84f69ac144bb6b205efb2d31c830c" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43885 } } }
I20260809 02:21:49.379746 26037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 024a6edcd2314db79e5d0f3a390ae618 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:21:49.379923 26084 mvcc.cc:205] Tried to move back new op lower bound from 7316447679981318144 to 7316447679971540992. Current Snapshot: MvccSnapshot[applied={T|T < 7316447679981318144}]
I20260809 02:21:49.380849 26080 catalog_manager.cc:1347] Generated new cluster ID: 816857c3cb424ef6b56cc96895587985
I20260809 02:21:49.380895 26080 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:21:49.395543 26080 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:21:49.396333 26080 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:21:49.411068 26080 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 47c84f69ac144bb6b205efb2d31c830c: Generated new TSK 0
I20260809 02:21:49.411336 26080 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:21:50.288830 26048 catalog_manager.cc:1259] Loaded cluster ID: 816857c3cb424ef6b56cc96895587985
I20260809 02:21:50.288906 26048 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 024a6edcd2314db79e5d0f3a390ae618: loading cluster ID for follower catalog manager: success
I20260809 02:21:50.289686 26048 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 024a6edcd2314db79e5d0f3a390ae618: acquiring CA information for follower catalog manager: success
I20260809 02:21:50.289947 26048 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 024a6edcd2314db79e5d0f3a390ae618: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:21:50.342669 26075 catalog_manager.cc:1259] Loaded cluster ID: 816857c3cb424ef6b56cc96895587985
I20260809 02:21:50.342752 26075 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c7e37a0c27ac48e9a96de81b30345f57: loading cluster ID for follower catalog manager: success
I20260809 02:21:50.343621 26075 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c7e37a0c27ac48e9a96de81b30345f57: acquiring CA information for follower catalog manager: success
I20260809 02:21:50.343955 26075 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c7e37a0c27ac48e9a96de81b30345f57: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:21:50.466184 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 25791
I20260809 02:21:50.473531 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 25868
I20260809 02:21:50.479841 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 25949
2026-08-09T02:21:50Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2895 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:21:50 dist-test-slave-w206 krb5kdc[26097](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:21:50 dist-test-slave-w206 krb5kdc[26097](info): set up 2 sockets
Aug 09 02:21:50 dist-test-slave-w206 krb5kdc[26097](info): commencing operation
krb5kdc: starting...
W20260809 02:21:51.547478 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.047s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:21:51 dist-test-slave-w206 krb5kdc[26097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242111, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:21:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:21:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:21:51.673847 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:40381
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:33163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:40381
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:51.768155 26112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:51.768445 26112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:51.768491 26112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:51.769749 26112 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:51.769789 26112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:51.769804 26112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:51.769841 26112 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:51.769868 26112 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:21:51.771391 26112 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:33163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:40381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:40381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26112
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:51.771631 26112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:51.771867 26112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:51.776984 26119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:51.776968 26121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:51.776966 26118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:51.777213 26112 server_base.cc:1034] running on GCE node
I20260809 02:21:51.777419 26112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:51.777658 26112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:51.778795 26112 hybrid_clock.cc:648] HybridClock initialized: now 1786242111778777 us; error 32 us; skew 500 ppm
Aug 09 02:21:51 dist-test-slave-w206 krb5kdc[26097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242111, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:51.781324 26112 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:21:51.781805 26112 webserver.cc:460] Webserver started at http://127.11.93.190:45025/ using document root <none> and password file <none>
I20260809 02:21:51.782033 26112 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:51.782100 26112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:51.782255 26112 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:51.783388 26112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "c0ffa32c7a194bd7abee38026acd209c"
format_stamp: "Formatted at 2026-08-09 02:21:51 on dist-test-slave-w206"
server_key: "42552bfdc6002bb8c9d258a102fe1dfb"
server_key_iv: "8c0c705da5590619cffa194486cc3b19"
server_key_version: "encryptionkey@0"
I20260809 02:21:51.783748 26112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "c0ffa32c7a194bd7abee38026acd209c"
format_stamp: "Formatted at 2026-08-09 02:21:51 on dist-test-slave-w206"
server_key: "42552bfdc6002bb8c9d258a102fe1dfb"
server_key_iv: "8c0c705da5590619cffa194486cc3b19"
server_key_version: "encryptionkey@0"
I20260809 02:21:51.785108 26112 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:51.785835 26128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:51.786005 26112 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:21:51.786108 26112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "c0ffa32c7a194bd7abee38026acd209c"
format_stamp: "Formatted at 2026-08-09 02:21:51 on dist-test-slave-w206"
server_key: "42552bfdc6002bb8c9d258a102fe1dfb"
server_key_iv: "8c0c705da5590619cffa194486cc3b19"
server_key_version: "encryptionkey@0"
I20260809 02:21:51.786182 26112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:51.814834 26112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:51.817255 26112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:51.817431 26112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:51.821930 26112 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:40381
I20260809 02:21:51.821987 26182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:40381 every 8 connection(s)
I20260809 02:21:51.822371 26112 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:21:51.823263 26183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:51.825580 26183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0ffa32c7a194bd7abee38026acd209c: Bootstrap starting.
I20260809 02:21:51.826157 26183 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0ffa32c7a194bd7abee38026acd209c: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:51.826388 26183 log.cc:824] T 00000000000000000000000000000000 P c0ffa32c7a194bd7abee38026acd209c: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:51.827134 26183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0ffa32c7a194bd7abee38026acd209c: No bootstrap required, opened a new log
I20260809 02:21:51.828651 26183 raft_consensus.cc:348] T 00000000000000000000000000000000 P c0ffa32c7a194bd7abee38026acd209c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0ffa32c7a194bd7abee38026acd209c" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40381 } }
I20260809 02:21:51.828791 26183 raft_consensus.cc:374] T 00000000000000000000000000000000 P c0ffa32c7a194bd7abee38026acd209c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:51.828814 26183 raft_consensus.cc:729] T 00000000000000000000000000000000 P c0ffa32c7a194bd7abee38026acd209c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0ffa32c7a194bd7abee38026acd209c, State: Initialized, Role: FOLLOWER
I20260809 02:21:51.828923 26183 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0ffa32c7a194bd7abee38026acd209c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0ffa32c7a194bd7abee38026acd209c" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40381 } }
I20260809 02:21:51.828979 26183 raft_consensus.cc:388] T 00000000000000000000000000000000 P c0ffa32c7a194bd7abee38026acd209c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:21:51.828999 26183 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0ffa32c7a194bd7abee38026acd209c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:21:51.829026 26183 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0ffa32c7a194bd7abee38026acd209c [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:51.829515 26183 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0ffa32c7a194bd7abee38026acd209c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0ffa32c7a194bd7abee38026acd209c" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40381 } }
I20260809 02:21:51.829638 26183 leader_election.cc:302] T 00000000000000000000000000000000 P c0ffa32c7a194bd7abee38026acd209c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c0ffa32c7a194bd7abee38026acd209c; no voters:
I20260809 02:21:51.829802 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 26112
I20260809 02:21:51.829824 26183 leader_election.cc:288] T 00000000000000000000000000000000 P c0ffa32c7a194bd7abee38026acd209c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:21:51.829890 26186 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0ffa32c7a194bd7abee38026acd209c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:51.829919 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:21:51.830047 26186 raft_consensus.cc:686] T 00000000000000000000000000000000 P c0ffa32c7a194bd7abee38026acd209c [term 1 LEADER]: Becoming Leader. State: Replica: c0ffa32c7a194bd7abee38026acd209c, State: Running, Role: LEADER
I20260809 02:21:51.830106 26183 sys_catalog.cc:564] T 00000000000000000000000000000000 P c0ffa32c7a194bd7abee38026acd209c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:51.830137 11638 external_mini_cluster.cc:1428] Setting key 687f01d7ec2a0192e3f8728b28d437d1
I20260809 02:21:51.830225 26186 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0ffa32c7a194bd7abee38026acd209c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0ffa32c7a194bd7abee38026acd209c" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40381 } }
I20260809 02:21:51.830648 26186 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0ffa32c7a194bd7abee38026acd209c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0ffa32c7a194bd7abee38026acd209c. Latest consensus state: current_term: 1 leader_uuid: "c0ffa32c7a194bd7abee38026acd209c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0ffa32c7a194bd7abee38026acd209c" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40381 } } }
I20260809 02:21:51.830796 26186 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0ffa32c7a194bd7abee38026acd209c [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:51.830807 26188 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0ffa32c7a194bd7abee38026acd209c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c0ffa32c7a194bd7abee38026acd209c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0ffa32c7a194bd7abee38026acd209c" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40381 } } }
I20260809 02:21:51.830936 26188 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0ffa32c7a194bd7abee38026acd209c [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:51.831430 26198 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:21:51.832077 26198 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:21:51.833642 26198 catalog_manager.cc:1347] Generated new cluster ID: d1619081628e4bd4976b038ea4343dec
I20260809 02:21:51.833693 26198 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 02:21:51 dist-test-slave-w206 krb5kdc[26097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242111, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:21:51.840553 26196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:51.830773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59650 (local address 127.11.93.190:40381)
0809 02:21:51.831092 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:51.831102 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:51.831143 (+ 41us) server_negotiation.cc:407] Connection header received
0809 02:21:51.831259 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:51.831267 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:51.831327 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:51.832332 (+ 1005us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:51.832408 (+ 76us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:51.833628 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:51.834400 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:51.834835 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:51.834963 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:51.837249 (+ 2286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:51.837253 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:51.837253 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:51.837265 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:51.838957 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:51.839394 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:51.839396 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:51.839397 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:51.839487 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:51.839707 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:51.839708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:51.839708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:51.839965 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:51.840147 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:51.840246 (+ 99us) server_negotiation.cc:299] Negotiation successful
0809 02:21:51.840386 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":103,"threads_started":1}
I20260809 02:21:51.841223 26198 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:21:51.841835 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:21:51.841938 26198 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:21:51.849735 26198 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c0ffa32c7a194bd7abee38026acd209c: Generated new TSK 0
I20260809 02:21:51.849924 26198 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:21:51.895828 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 26112
2026-08-09T02:21:51Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1414 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:21:51 dist-test-slave-w206 krb5kdc[26211](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:21:51 dist-test-slave-w206 krb5kdc[26211](info): set up 2 sockets
Aug 09 02:21:51 dist-test-slave-w206 krb5kdc[26211](info): commencing operation
krb5kdc: starting...
W20260809 02:21:52.969834 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.054s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:21:53 dist-test-slave-w206 krb5kdc[26211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242113, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:21:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:21:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:21:53.097839 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:42131
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:40317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:42131
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:53.181876 26226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:53.182086 26226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:53.182109 26226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:53.183336 26226 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:53.183382 26226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:53.183398 26226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:53.183410 26226 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:53.183422 26226 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:21:53.184890 26226 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:40317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:42131
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:42131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:53.185077 26226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:53.185257 26226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:53.190138 26235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:53.190088 26237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:53.190088 26234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:53.190343 26226 server_base.cc:1034] running on GCE node
I20260809 02:21:53.190693 26226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:53.191063 26226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:53.192227 26226 hybrid_clock.cc:648] HybridClock initialized: now 1786242113192211 us; error 34 us; skew 500 ppm
Aug 09 02:21:53 dist-test-slave-w206 krb5kdc[26211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242113, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:53.200865 26226 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:21:53.201335 26226 webserver.cc:460] Webserver started at http://127.11.93.190:45511/ using document root <none> and password file <none>
I20260809 02:21:53.201609 26226 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:53.201679 26226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:53.201834 26226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:53.202930 26226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "9798651cded844258807b2be2aefac90"
format_stamp: "Formatted at 2026-08-09 02:21:53 on dist-test-slave-w206"
server_key: "ff3ad632da0c579622bd0bac489f7b1a"
server_key_iv: "b191315ea1aa2425f3cf24946879320f"
server_key_version: "encryptionkey@0"
I20260809 02:21:53.203372 26226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "9798651cded844258807b2be2aefac90"
format_stamp: "Formatted at 2026-08-09 02:21:53 on dist-test-slave-w206"
server_key: "ff3ad632da0c579622bd0bac489f7b1a"
server_key_iv: "b191315ea1aa2425f3cf24946879320f"
server_key_version: "encryptionkey@0"
I20260809 02:21:53.204726 26226 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:53.205461 26244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:53.205631 26226 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:21:53.205742 26226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "9798651cded844258807b2be2aefac90"
format_stamp: "Formatted at 2026-08-09 02:21:53 on dist-test-slave-w206"
server_key: "ff3ad632da0c579622bd0bac489f7b1a"
server_key_iv: "b191315ea1aa2425f3cf24946879320f"
server_key_version: "encryptionkey@0"
I20260809 02:21:53.205819 26226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:53.228288 26226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:53.230212 26226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:53.230379 26226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:53.234592 26226 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:42131
I20260809 02:21:53.234647 26301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:42131 every 8 connection(s)
I20260809 02:21:53.235033 26226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:21:53.236014 26302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:53.238209 26302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90: Bootstrap starting.
I20260809 02:21:53.238727 26302 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:53.239040 26302 log.cc:824] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:53.239742 26302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90: No bootstrap required, opened a new log
I20260809 02:21:53.241370 26302 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798651cded844258807b2be2aefac90" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42131 } }
I20260809 02:21:53.241508 26302 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:53.241530 26302 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9798651cded844258807b2be2aefac90, State: Initialized, Role: FOLLOWER
I20260809 02:21:53.241663 26302 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798651cded844258807b2be2aefac90" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42131 } }
I20260809 02:21:53.241744 26302 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:21:53.241768 26302 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:21:53.241796 26302 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:53.242573 26302 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798651cded844258807b2be2aefac90" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42131 } }
I20260809 02:21:53.242661 26302 leader_election.cc:302] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9798651cded844258807b2be2aefac90; no voters:
I20260809 02:21:53.242784 26302 leader_election.cc:288] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:21:53.242851 26305 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:53.243032 26305 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 1 LEADER]: Becoming Leader. State: Replica: 9798651cded844258807b2be2aefac90, State: Running, Role: LEADER
I20260809 02:21:53.243094 26302 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:53.243175 26305 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798651cded844258807b2be2aefac90" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42131 } }
I20260809 02:21:53.243577 26307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9798651cded844258807b2be2aefac90. Latest consensus state: current_term: 1 leader_uuid: "9798651cded844258807b2be2aefac90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798651cded844258807b2be2aefac90" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42131 } } }
I20260809 02:21:53.243661 26307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:53.243714 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 26226
I20260809 02:21:53.243841 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:21:53.243820 26306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9798651cded844258807b2be2aefac90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798651cded844258807b2be2aefac90" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42131 } } }
I20260809 02:21:53.243878 26306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:53.244000 26314 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:21:53.244086 11638 external_mini_cluster.cc:1428] Setting key d510fc18f0267dbc0897218662b55130
I20260809 02:21:53.244975 26314 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:21:53.246730 26314 catalog_manager.cc:1347] Generated new cluster ID: da9958194b0c4e3f8867cf34d83c0b57
I20260809 02:21:53.246783 26314 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 02:21:53 dist-test-slave-w206 krb5kdc[26211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242113, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:21:53.256461 26322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:53.244580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59188 (local address 127.11.93.190:42131)
0809 02:21:53.244742 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:53.244751 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:53.244809 (+ 58us) server_negotiation.cc:407] Connection header received
0809 02:21:53.245047 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:53.245056 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:53.245118 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:53.245232 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:53.246402 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.247818 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.248859 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.249502 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.249621 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:53.252557 (+ 2936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:53.252561 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:53.252561 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:53.252574 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:53.254627 (+ 2053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:53.255061 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:53.255064 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:53.255064 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:53.255174 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:53.255406 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:53.255407 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:53.255407 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:53.255709 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:53.255860 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:53.255995 (+ 135us) server_negotiation.cc:299] Negotiation successful
0809 02:21:53.256228 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":67,"threads_started":1}
I20260809 02:21:53.258770 26314 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:21:53.259485 26314 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:21:53.277245 26314 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90: Generated new TSK 0
I20260809 02:21:53.277493 26314 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.93.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
I20260809 02:21:53.306152 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:42131
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:40317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:53.389179 26330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:53.389415 26330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:53.389454 26330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:53.390611 26330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:53.390677 26330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:53.390722 26330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:21:53.392237 26330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:40317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:42131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:53.392509 26330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:53.392745 26330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:53.397915 26339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:53.397897 26336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:53.397933 26330 server_base.cc:1034] running on GCE node
W20260809 02:21:53.397926 26337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:53.398336 26330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:53.398545 26330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:53.399714 26330 hybrid_clock.cc:648] HybridClock initialized: now 1786242113399705 us; error 37 us; skew 500 ppm
Aug 09 02:21:53 dist-test-slave-w206 krb5kdc[26211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242113, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:53.402477 26330 init.cc:377] Logged in from keytab as kudu/127.11.93.129@KRBTEST.COM (short username kudu)
I20260809 02:21:53.402876 26330 webserver.cc:460] Webserver started at http://127.11.93.129:37627/ using document root <none> and password file <none>
I20260809 02:21:53.403127 26330 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:53.403174 26330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:53.403266 26330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:53.404336 26330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "523aaf1686164a4e821badd45f8acd8a"
format_stamp: "Formatted at 2026-08-09 02:21:53 on dist-test-slave-w206"
server_key: "86ab643613b4c298dd78395c825d73e8"
server_key_iv: "344f8c7dd453b143ba84471e4eb40c35"
server_key_version: "encryptionkey@0"
I20260809 02:21:53.404646 26330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "523aaf1686164a4e821badd45f8acd8a"
format_stamp: "Formatted at 2026-08-09 02:21:53 on dist-test-slave-w206"
server_key: "86ab643613b4c298dd78395c825d73e8"
server_key_iv: "344f8c7dd453b143ba84471e4eb40c35"
server_key_version: "encryptionkey@0"
I20260809 02:21:53.405930 26330 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:21:53.406641 26346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:53.406821 26330 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:21:53.406909 26330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "523aaf1686164a4e821badd45f8acd8a"
format_stamp: "Formatted at 2026-08-09 02:21:53 on dist-test-slave-w206"
server_key: "86ab643613b4c298dd78395c825d73e8"
server_key_iv: "344f8c7dd453b143ba84471e4eb40c35"
server_key_version: "encryptionkey@0"
I20260809 02:21:53.407008 26330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:53.452911 26330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:53.454891 26330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:53.455080 26330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:53.455356 26330 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:53.455713 26330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:53.455750 26330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:53.455775 26330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:53.455825 26330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:53.461553 26330 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:34185
I20260809 02:21:53.461637 26468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:34185 every 8 connection(s)
I20260809 02:21:53.461967 26330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:21:53.462654 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 26330
I20260809 02:21:53.462779 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:21:53.463052 11638 external_mini_cluster.cc:1428] Setting key ac814e1c399ee8b2f7521376a87759c2
Aug 09 02:21:53 dist-test-slave-w206 krb5kdc[26211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242113, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:21:53.472952 26471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:53.462701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.129:55585)
0809 02:21:53.462894 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:53.462937 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:53.463649 (+ 712us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:53.463924 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:53.463928 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:53.464815 (+ 887us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:53.465097 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:53.465103 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.465852 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.465853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:53.466751 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:53.466754 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.467346 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.467346 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:53.467503 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:53.468020 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:53.468030 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:53.469682 (+ 1652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:53.471597 (+ 1915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:53.471604 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:53.471606 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:53.471824 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:53.472057 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:53.472058 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:53.472058 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:53.472157 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:53.472453 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:53.472458 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:53.472571 (+ 113us) client_negotiation.cc:769] Sending connection context
0809 02:21:53.472655 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 02:21:53.472772 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":101,"threads_started":1}
I20260809 02:21:53.472952 26322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:53.463210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:55585 (local address 127.11.93.190:42131)
0809 02:21:53.463269 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:53.463271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:53.463284 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:21:53.463756 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:53.463757 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:53.463773 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:53.463831 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:53.465201 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.465750 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.466859 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.467199 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.467247 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:53.469785 (+ 2538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:53.469787 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:53.469788 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:53.469796 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:53.471499 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:53.471917 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:53.471918 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:53.471919 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:53.471984 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:53.472229 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:53.472230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:53.472231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:53.472370 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:53.472462 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:53.472708 (+ 246us) server_negotiation.cc:299] Negotiation successful
0809 02:21:53.472806 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
WARNING: no policy specified for kudu/127.11.93.130@KRBTEST.COM; defaulting to no policy
I20260809 02:21:53.473510 26469 heartbeater.cc:347] Connected to a master server at 127.11.93.190:42131
I20260809 02:21:53.473616 26469 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:53.473821 26469 heartbeater.cc:511] Master 127.11.93.190:42131 requested a full tablet report, sending...
I20260809 02:21:53.474334 26263 ts_manager.cc:194] Registered new tserver with Master: 523aaf1686164a4e821badd45f8acd8a (127.11.93.129:34185)
I20260809 02:21:53.475107 26263 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:55585
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
I20260809 02:21:53.489938 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:42131
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:40317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:53.571720 26474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:53.571995 26474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:53.572032 26474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:53.573158 26474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:53.573227 26474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:53.573272 26474 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:21:53.574764 26474 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:40317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:42131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26474
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:53.575066 26474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:53.575311 26474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:53.580334 26482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:53.580360 26479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:53.580313 26480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:53.580629 26474 server_base.cc:1034] running on GCE node
I20260809 02:21:53.580874 26474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:53.581126 26474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:53.582290 26474 hybrid_clock.cc:648] HybridClock initialized: now 1786242113582285 us; error 37 us; skew 500 ppm
Aug 09 02:21:53 dist-test-slave-w206 krb5kdc[26211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242113, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:53.585222 26474 init.cc:377] Logged in from keytab as kudu/127.11.93.130@KRBTEST.COM (short username kudu)
I20260809 02:21:53.585603 26474 webserver.cc:460] Webserver started at http://127.11.93.130:41655/ using document root <none> and password file <none>
I20260809 02:21:53.585781 26474 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:53.585822 26474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:53.585906 26474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:53.586870 26474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "b8f7791c70404b658cb9d853720d6f7b"
format_stamp: "Formatted at 2026-08-09 02:21:53 on dist-test-slave-w206"
server_key: "8d7fc83d0f784006db2865faca194297"
server_key_iv: "e64c6eb250d771d29593698a5235ec04"
server_key_version: "encryptionkey@0"
I20260809 02:21:53.587255 26474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "b8f7791c70404b658cb9d853720d6f7b"
format_stamp: "Formatted at 2026-08-09 02:21:53 on dist-test-slave-w206"
server_key: "8d7fc83d0f784006db2865faca194297"
server_key_iv: "e64c6eb250d771d29593698a5235ec04"
server_key_version: "encryptionkey@0"
I20260809 02:21:53.588843 26474 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:53.589726 26489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:53.589918 26474 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:53.590008 26474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "b8f7791c70404b658cb9d853720d6f7b"
format_stamp: "Formatted at 2026-08-09 02:21:53 on dist-test-slave-w206"
server_key: "8d7fc83d0f784006db2865faca194297"
server_key_iv: "e64c6eb250d771d29593698a5235ec04"
server_key_version: "encryptionkey@0"
I20260809 02:21:53.590080 26474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:53.604617 26474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:53.607138 26474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:53.607312 26474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:53.607555 26474 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:53.607875 26474 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:53.607918 26474 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:53.607965 26474 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:53.608001 26474 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:53.614344 26474 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:40303
I20260809 02:21:53.614394 26610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:40303 every 8 connection(s)
I20260809 02:21:53.614708 26474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:21:53.615144 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 26474
I20260809 02:21:53.615260 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:21:53.615536 11638 external_mini_cluster.cc:1428] Setting key a755e21725526a2cf1024fd0e03368bd
Aug 09 02:21:53 dist-test-slave-w206 krb5kdc[26211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242113, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.93.131@KRBTEST.COM; defaulting to no policy
I20260809 02:21:53.625279 26322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:53.615543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:58111 (local address 127.11.93.190:42131)
0809 02:21:53.615622 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:53.615625 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:53.615866 (+ 241us) server_negotiation.cc:407] Connection header received
0809 02:21:53.616534 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:53.616535 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:53.616545 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:53.616592 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:53.617932 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.618507 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.619578 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.619785 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.619874 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:53.622031 (+ 2157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:53.622033 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:53.622033 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:53.622041 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:53.623690 (+ 1649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:53.624112 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:53.624114 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:53.624115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:53.624178 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:53.624548 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:53.624550 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:53.624550 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:53.624712 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:53.624798 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:53.625054 (+ 256us) server_negotiation.cc:299] Negotiation successful
0809 02:21:53.625148 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:21:53.625365 26613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:53.615459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.130:58111)
0809 02:21:53.615708 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:53.615758 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:53.616401 (+ 643us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:53.616676 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:53.616681 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:53.617541 (+ 860us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:53.617821 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:53.617827 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.618608 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.618609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:53.619483 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:53.619486 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.619886 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.619887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:53.620023 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:53.620565 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:53.620573 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:53.621936 (+ 1363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:53.623791 (+ 1855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:53.623797 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:53.623798 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:53.624018 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:53.624350 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:53.624351 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:53.624351 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:53.624463 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:53.624789 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:53.624793 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:53.624923 (+ 130us) client_negotiation.cc:769] Sending connection context
0809 02:21:53.625007 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 02:21:53.625131 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":80,"threads_started":1}
I20260809 02:21:53.625883 26611 heartbeater.cc:347] Connected to a master server at 127.11.93.190:42131
I20260809 02:21:53.625984 26611 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:53.626127 26611 heartbeater.cc:511] Master 127.11.93.190:42131 requested a full tablet report, sending...
I20260809 02:21:53.626555 26263 ts_manager.cc:194] Registered new tserver with Master: b8f7791c70404b658cb9d853720d6f7b (127.11.93.130:40303)
I20260809 02:21:53.626888 26263 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:58111
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
I20260809 02:21:53.642148 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:42131
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:40317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:53.727583 26616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:53.727784 26616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:53.727807 26616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:53.728920 26616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:53.728956 26616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:53.728982 26616 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:21:53.730350 26616 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:40317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:42131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26616
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:53.730541 26616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:53.730726 26616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:53.735874 26622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:53.735870 26623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:53.735865 26626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:53.736105 26616 server_base.cc:1034] running on GCE node
I20260809 02:21:53.736363 26616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:53.736603 26616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:53.737763 26616 hybrid_clock.cc:648] HybridClock initialized: now 1786242113737747 us; error 27 us; skew 500 ppm
Aug 09 02:21:53 dist-test-slave-w206 krb5kdc[26211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242113, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:53.740420 26616 init.cc:377] Logged in from keytab as kudu/127.11.93.131@KRBTEST.COM (short username kudu)
I20260809 02:21:53.740899 26616 webserver.cc:460] Webserver started at http://127.11.93.131:39417/ using document root <none> and password file <none>
I20260809 02:21:53.741148 26616 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:53.741215 26616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:53.741364 26616 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:21:53.742422 26616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "5000f48bb66e4a52938757a3396e54ec"
format_stamp: "Formatted at 2026-08-09 02:21:53 on dist-test-slave-w206"
server_key: "8eed2eac5ef3dbac32503e7eba4ca2cf"
server_key_iv: "300dd71922b151d8ff26631868e77273"
server_key_version: "encryptionkey@0"
I20260809 02:21:53.742839 26616 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "5000f48bb66e4a52938757a3396e54ec"
format_stamp: "Formatted at 2026-08-09 02:21:53 on dist-test-slave-w206"
server_key: "8eed2eac5ef3dbac32503e7eba4ca2cf"
server_key_iv: "300dd71922b151d8ff26631868e77273"
server_key_version: "encryptionkey@0"
I20260809 02:21:53.744386 26616 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:53.745162 26633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:53.745335 26616 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:21:53.745425 26616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "5000f48bb66e4a52938757a3396e54ec"
format_stamp: "Formatted at 2026-08-09 02:21:53 on dist-test-slave-w206"
server_key: "8eed2eac5ef3dbac32503e7eba4ca2cf"
server_key_iv: "300dd71922b151d8ff26631868e77273"
server_key_version: "encryptionkey@0"
I20260809 02:21:53.745507 26616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:53.765487 26616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:53.767377 26616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:53.767580 26616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:53.767865 26616 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:53.768220 26616 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:53.768255 26616 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:53.768280 26616 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:53.768326 26616 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:53.774063 26616 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:36439
I20260809 02:21:53.774108 26752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:36439 every 8 connection(s)
I20260809 02:21:53.774420 26616 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:21:53.778154 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 26616
I20260809 02:21:53.778247 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:21:53.778430 11638 external_mini_cluster.cc:1428] Setting key a4c7048674d9f186187a1454906688e5
Aug 09 02:21:53 dist-test-slave-w206 krb5kdc[26211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242113, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:21:53.784432 26322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:53.775158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:60143 (local address 127.11.93.190:42131)
0809 02:21:53.775238 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:53.775240 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:53.775469 (+ 229us) server_negotiation.cc:407] Connection header received
0809 02:21:53.775929 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:53.775930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:53.775940 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:53.775991 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:53.777333 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.777913 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.779480 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.779662 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.779716 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:53.781764 (+ 2048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:53.781766 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:53.781766 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:53.781772 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:53.783254 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:53.783630 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:53.783631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:53.783631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:53.783681 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:53.783888 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:53.783888 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:53.783888 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:53.783986 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:53.784037 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:53.784300 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 02:21:53.784369 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:21:53.784592 26755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:53.775141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.131:60143)
0809 02:21:53.775331 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:53.775379 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:53.775845 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:53.776044 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:53.776047 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:53.776871 (+ 824us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:53.777144 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:53.777151 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.778012 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.778013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:53.779410 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:53.779413 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.779733 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.779734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:53.779832 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:53.780273 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:53.780281 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:53.781680 (+ 1399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:53.783348 (+ 1668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:53.783354 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:53.783356 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:53.783565 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:53.783738 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:53.783739 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:53.783739 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:53.783834 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:53.784040 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:53.784044 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:53.784151 (+ 107us) client_negotiation.cc:769] Sending connection context
0809 02:21:53.784273 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 02:21:53.784390 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":106,"threads_started":1}
I20260809 02:21:53.785040 26753 heartbeater.cc:347] Connected to a master server at 127.11.93.190:42131
I20260809 02:21:53.785140 26753 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:53.785322 26753 heartbeater.cc:511] Master 127.11.93.190:42131 requested a full tablet report, sending...
I20260809 02:21:53.785701 26263 ts_manager.cc:194] Registered new tserver with Master: 5000f48bb66e4a52938757a3396e54ec (127.11.93.131:36439)
I20260809 02:21:53.786056 26263 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:60143
I20260809 02:21:53.790391 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:21:53.797363 26322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:53.791724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59200 (local address 127.11.93.190:42131)
0809 02:21:53.791778 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:53.791780 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:53.791851 (+ 71us) server_negotiation.cc:407] Connection header received
0809 02:21:53.791893 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:53.791893 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:53.791904 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:53.791952 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:53.792499 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.793044 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.793745 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.793972 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.794025 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:53.795255 (+ 1230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:53.795256 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:53.795256 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:53.795262 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:53.796420 (+ 1158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:53.796715 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:53.796716 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:53.796716 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:53.796766 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:53.796938 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:53.796938 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:53.796939 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:53.797070 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:53.797144 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:53.797246 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 02:21:53.797304 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 02:21:53.798882 26263 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59200:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:21:53.800567 26263 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:21:53.807456 26766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:53.802870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:36439 (local address 127.0.0.1:47484)
0809 02:21:53.803078 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:53.803119 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:53.803186 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:53.803588 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:53.803592 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:53.803596 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:53.803675 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:53.803678 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.804933 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.804934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:53.806204 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:53.806207 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.807137 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.807138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:53.807228 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:53.807243 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 02:21:53.807323 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 02:21:53.807375 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":53,"threads_started":1}
I20260809 02:21:53.807469 26767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:53.802935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47484 (local address 127.11.93.131:36439)
0809 02:21:53.803341 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:53.803346 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:53.803356 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:21:53.803406 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:53.803408 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:53.803423 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:53.803532 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:53.803768 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.804829 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.806291 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.807052 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.807128 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:53.807184 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:53.807345 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 02:21:53.807385 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":115,"threads_started":1}
I20260809 02:21:53.807952 26768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:53.802873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:40303 (local address 127.0.0.1:40302)
0809 02:21:53.803226 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:53.803276 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:53.803326 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:53.804543 (+ 1217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:53.804544 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:53.804546 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:53.804597 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:53.804599 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.805568 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.805569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:53.806611 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:53.806614 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.807758 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.807759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:53.807815 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:53.807818 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:21:53.807850 (+ 32us) client_negotiation.cc:240] Negotiation successful
0809 02:21:53.807885 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"mutex_wait_us":11,"thread_start_us":128,"threads_started":1}
I20260809 02:21:53.807978 26769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:53.803347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60662 (local address 127.11.93.129:34185)
0809 02:21:53.803532 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:53.803536 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:53.804434 (+ 898us) server_negotiation.cc:407] Connection header received
0809 02:21:53.804512 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:53.804515 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:53.804529 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:53.804624 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:53.804734 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.805803 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.806873 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.807623 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.807711 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:53.807771 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:53.807855 (+ 84us) server_negotiation.cc:299] Negotiation successful
0809 02:21:53.807900 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":89,"threads_started":1}
I20260809 02:21:53.808311 26770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:53.804181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40302 (local address 127.11.93.130:40303)
0809 02:21:53.804368 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:53.804373 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:53.804383 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:21:53.804421 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:53.804423 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:53.804438 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:53.804658 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:53.804724 (+ 66us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.805461 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.806717 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.807470 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.808095 (+ 625us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:53.808159 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:53.808186 (+ 27us) server_negotiation.cc:299] Negotiation successful
0809 02:21:53.808229 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":87,"threads_started":1}
I20260809 02:21:53.808314 26684 tablet_service.cc:1467] Processing CreateTablet for tablet c665e76f87f54f148c0f0f76fa2a3884 (DEFAULT_TABLE table=test-table [id=0a9b57bd8c1a44258e4cb4adee99f042]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:53.808750 26684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c665e76f87f54f148c0f0f76fa2a3884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:53.808939 26539 tablet_service.cc:1467] Processing CreateTablet for tablet c665e76f87f54f148c0f0f76fa2a3884 (DEFAULT_TABLE table=test-table [id=0a9b57bd8c1a44258e4cb4adee99f042]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:53.809303 26539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c665e76f87f54f148c0f0f76fa2a3884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:53.811260 26765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:53.803100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:34185 (local address 127.0.0.1:60662)
0809 02:21:53.804347 (+ 1247us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:53.804362 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:53.804444 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:53.804621 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:53.804621 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:53.804623 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:53.804677 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:53.804679 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.805930 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.805931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:53.806787 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:53.806790 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.807713 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.807714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:53.807777 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:53.807781 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:21:53.807841 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 02:21:53.811173 (+ 3332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1236,"thread_start_us":88,"threads_started":1}
I20260809 02:21:53.811831 26771 tablet_bootstrap.cc:492] T c665e76f87f54f148c0f0f76fa2a3884 P 5000f48bb66e4a52938757a3396e54ec: Bootstrap starting.
I20260809 02:21:53.811998 26397 tablet_service.cc:1467] Processing CreateTablet for tablet c665e76f87f54f148c0f0f76fa2a3884 (DEFAULT_TABLE table=test-table [id=0a9b57bd8c1a44258e4cb4adee99f042]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:53.812353 26397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c665e76f87f54f148c0f0f76fa2a3884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:53.812619 26772 tablet_bootstrap.cc:492] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b: Bootstrap starting.
I20260809 02:21:53.812659 26771 tablet_bootstrap.cc:654] T c665e76f87f54f148c0f0f76fa2a3884 P 5000f48bb66e4a52938757a3396e54ec: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:53.813125 26771 log.cc:824] T c665e76f87f54f148c0f0f76fa2a3884 P 5000f48bb66e4a52938757a3396e54ec: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:53.813266 26772 tablet_bootstrap.cc:654] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:53.813818 26771 tablet_bootstrap.cc:492] T c665e76f87f54f148c0f0f76fa2a3884 P 5000f48bb66e4a52938757a3396e54ec: No bootstrap required, opened a new log
I20260809 02:21:53.813812 26772 log.cc:824] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:53.813906 26771 ts_tablet_manager.cc:1397] T c665e76f87f54f148c0f0f76fa2a3884 P 5000f48bb66e4a52938757a3396e54ec: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:21:53.814616 26772 tablet_bootstrap.cc:492] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b: No bootstrap required, opened a new log
I20260809 02:21:53.814694 26772 ts_tablet_manager.cc:1397] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:21:53.815680 26771 raft_consensus.cc:348] T c665e76f87f54f148c0f0f76fa2a3884 P 5000f48bb66e4a52938757a3396e54ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:53.815873 26771 raft_consensus.cc:374] T c665e76f87f54f148c0f0f76fa2a3884 P 5000f48bb66e4a52938757a3396e54ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:53.815918 26771 raft_consensus.cc:729] T c665e76f87f54f148c0f0f76fa2a3884 P 5000f48bb66e4a52938757a3396e54ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5000f48bb66e4a52938757a3396e54ec, State: Initialized, Role: FOLLOWER
I20260809 02:21:53.816033 26771 consensus_queue.cc:260] T c665e76f87f54f148c0f0f76fa2a3884 P 5000f48bb66e4a52938757a3396e54ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:53.816355 26771 ts_tablet_manager.cc:1428] T c665e76f87f54f148c0f0f76fa2a3884 P 5000f48bb66e4a52938757a3396e54ec: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 02:21:53.816401 26753 heartbeater.cc:503] Master 127.11.93.190:42131 was elected leader, sending a full tablet report...
I20260809 02:21:53.816756 26772 raft_consensus.cc:348] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:53.816924 26772 raft_consensus.cc:374] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:53.816972 26772 raft_consensus.cc:729] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8f7791c70404b658cb9d853720d6f7b, State: Initialized, Role: FOLLOWER
I20260809 02:21:53.817096 26772 consensus_queue.cc:260] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:53.817373 26611 heartbeater.cc:503] Master 127.11.93.190:42131 was elected leader, sending a full tablet report...
I20260809 02:21:53.817582 26772 ts_tablet_manager.cc:1428] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 02:21:53.817772 26775 tablet_bootstrap.cc:492] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a: Bootstrap starting.
I20260809 02:21:53.818346 26775 tablet_bootstrap.cc:654] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:53.818758 26775 log.cc:824] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:53.819443 26775 tablet_bootstrap.cc:492] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a: No bootstrap required, opened a new log
I20260809 02:21:53.819495 26775 ts_tablet_manager.cc:1397] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:21:53.821007 26775 raft_consensus.cc:348] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:53.821121 26775 raft_consensus.cc:374] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:53.821141 26775 raft_consensus.cc:729] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523aaf1686164a4e821badd45f8acd8a, State: Initialized, Role: FOLLOWER
I20260809 02:21:53.821245 26775 consensus_queue.cc:260] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:53.821480 26775 ts_tablet_manager.cc:1428] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:53.821543 26469 heartbeater.cc:503] Master 127.11.93.190:42131 was elected leader, sending a full tablet report...
W20260809 02:21:53.865388 26612 tablet.cc:2369] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:21:53.961759 26777 raft_consensus.cc:482] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:21:53.961907 26777 raft_consensus.cc:504] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:53.962247 26777 leader_election.cc:288] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5000f48bb66e4a52938757a3396e54ec (127.11.93.131:36439), 523aaf1686164a4e821badd45f8acd8a (127.11.93.129:34185)
W20260809 02:21:53.962738 26470 tablet.cc:2369] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:21:53.965209 26613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:53.962466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:36439 (local address 127.11.93.130:58765)
0809 02:21:53.962548 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:53.962566 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:53.962633 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:53.962902 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:53.962903 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:53.962904 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:53.963001 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:53.963003 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.963660 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.963662 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:53.964386 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:53.964388 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.964945 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.964946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:53.965029 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:53.965032 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:21:53.965098 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 02:21:53.965137 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":5}
I20260809 02:21:53.965207 26767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:53.962575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:58765 (local address 127.11.93.131:36439)
0809 02:21:53.962727 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:53.962729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:53.962738 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:21:53.962768 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:53.962769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:53.962778 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:53.962826 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:53.963088 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.963570 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.964480 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.964859 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.964949 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:53.964958 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:53.965104 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 02:21:53.965138 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128}
I20260809 02:21:53.965324 26769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:53.962690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:34389 (local address 127.11.93.129:34185)
0809 02:21:53.962738 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:53.962740 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:53.962848 (+ 108us) server_negotiation.cc:407] Connection header received
0809 02:21:53.962964 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:53.962965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:53.962992 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:53.963066 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:53.963221 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.963687 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.964615 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.964980 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.965067 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:53.965075 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:53.965227 (+ 152us) server_negotiation.cc:299] Negotiation successful
0809 02:21:53.965263 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 02:21:53.965332 26780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:53.962597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:34185 (local address 127.11.93.130:34389)
0809 02:21:53.962769 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:53.962778 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:53.962876 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:53.963069 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:53.963070 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:53.963072 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:53.963142 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:53.963144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.963777 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.963779 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:53.964519 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:53.964521 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.965067 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.965068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:53.965139 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:53.965142 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:21:53.965209 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 02:21:53.965249 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":109,"threads_started":1}
I20260809 02:21:53.965555 26705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c665e76f87f54f148c0f0f76fa2a3884" candidate_uuid: "b8f7791c70404b658cb9d853720d6f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5000f48bb66e4a52938757a3396e54ec" is_pre_election: true
I20260809 02:21:53.965739 26705 raft_consensus.cc:2454] T c665e76f87f54f148c0f0f76fa2a3884 P 5000f48bb66e4a52938757a3396e54ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8f7791c70404b658cb9d853720d6f7b in term 0.
I20260809 02:21:53.966041 26491 leader_election.cc:302] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5000f48bb66e4a52938757a3396e54ec, b8f7791c70404b658cb9d853720d6f7b; no voters:
I20260809 02:21:53.966183 26777 raft_consensus.cc:2781] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:21:53.966248 26777 raft_consensus.cc:482] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:21:53.966179 26418 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c665e76f87f54f148c0f0f76fa2a3884" candidate_uuid: "b8f7791c70404b658cb9d853720d6f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523aaf1686164a4e821badd45f8acd8a" is_pre_election: true
I20260809 02:21:53.966282 26777 raft_consensus.cc:3037] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:53.966337 26418 raft_consensus.cc:2454] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8f7791c70404b658cb9d853720d6f7b in term 0.
I20260809 02:21:53.967098 26777 raft_consensus.cc:504] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:53.967242 26777 leader_election.cc:288] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b [CANDIDATE]: Term 1 election: Requested vote from peers 5000f48bb66e4a52938757a3396e54ec (127.11.93.131:36439), 523aaf1686164a4e821badd45f8acd8a (127.11.93.129:34185)
I20260809 02:21:53.967425 26705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c665e76f87f54f148c0f0f76fa2a3884" candidate_uuid: "b8f7791c70404b658cb9d853720d6f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5000f48bb66e4a52938757a3396e54ec"
I20260809 02:21:53.967473 26418 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c665e76f87f54f148c0f0f76fa2a3884" candidate_uuid: "b8f7791c70404b658cb9d853720d6f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523aaf1686164a4e821badd45f8acd8a"
I20260809 02:21:53.967507 26705 raft_consensus.cc:3037] T c665e76f87f54f148c0f0f76fa2a3884 P 5000f48bb66e4a52938757a3396e54ec [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:53.967553 26418 raft_consensus.cc:3037] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:53.968377 26705 raft_consensus.cc:2454] T c665e76f87f54f148c0f0f76fa2a3884 P 5000f48bb66e4a52938757a3396e54ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8f7791c70404b658cb9d853720d6f7b in term 1.
I20260809 02:21:53.968385 26418 raft_consensus.cc:2454] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8f7791c70404b658cb9d853720d6f7b in term 1.
I20260809 02:21:53.968565 26491 leader_election.cc:302] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5000f48bb66e4a52938757a3396e54ec, b8f7791c70404b658cb9d853720d6f7b; no voters:
I20260809 02:21:53.968681 26777 raft_consensus.cc:2781] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:53.968890 26777 raft_consensus.cc:686] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b [term 1 LEADER]: Becoming Leader. State: Replica: b8f7791c70404b658cb9d853720d6f7b, State: Running, Role: LEADER
I20260809 02:21:53.968998 26777 consensus_queue.cc:237] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:53.969861 26263 catalog_manager.cc:5495] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b reported cstate change: term changed from 0 to 1, leader changed from <none> to b8f7791c70404b658cb9d853720d6f7b (127.11.93.130). New cstate: current_term: 1 leader_uuid: "b8f7791c70404b658cb9d853720d6f7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260809 02:21:53.989719 26770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:53.986737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40308 (local address 127.11.93.130:40303)
0809 02:21:53.986799 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:53.986801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:53.986809 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:21:53.986897 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:53.986897 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:53.986916 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:53.987032 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:21:53.987173 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.987634 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.988689 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:53.989041 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:53.989128 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:53.989292 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:21:53.989423 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:21:53.989504 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:53.989580 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 02:21:53.989603 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:21:53.991947 26705 raft_consensus.cc:1261] T c665e76f87f54f148c0f0f76fa2a3884 P 5000f48bb66e4a52938757a3396e54ec [term 1 FOLLOWER]: Refusing update from remote peer b8f7791c70404b658cb9d853720d6f7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:53.991930 26418 raft_consensus.cc:1261] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Refusing update from remote peer b8f7791c70404b658cb9d853720d6f7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:53.992358 26777 consensus_queue.cc:1035] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:53.992496 26781 consensus_queue.cc:1035] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:53.997076 26262 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59200:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:53.997184 26262 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59200:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:53.997956 26262 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90: Sending DeleteTablet for 3 replicas of tablet c665e76f87f54f148c0f0f76fa2a3884
I20260809 02:21:53.998304 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 26330
I20260809 02:21:53.998313 26684 tablet_service.cc:1514] Processing DeleteTablet for tablet c665e76f87f54f148c0f0f76fa2a3884 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:53 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:47484
I20260809 02:21:53.999577 26539 tablet_service.cc:1514] Processing DeleteTablet for tablet c665e76f87f54f148c0f0f76fa2a3884 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:53 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:40302
I20260809 02:21:54.000036 26796 tablet_replica.cc:330] T c665e76f87f54f148c0f0f76fa2a3884 P 5000f48bb66e4a52938757a3396e54ec: stopping tablet replica
I20260809 02:21:54.000177 26796 raft_consensus.cc:2229] T c665e76f87f54f148c0f0f76fa2a3884 P 5000f48bb66e4a52938757a3396e54ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:21:54.000312 26796 raft_consensus.cc:2258] T c665e76f87f54f148c0f0f76fa2a3884 P 5000f48bb66e4a52938757a3396e54ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:54.000770 26796 ts_tablet_manager.cc:1905] T c665e76f87f54f148c0f0f76fa2a3884 P 5000f48bb66e4a52938757a3396e54ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:54.000522 26798 tablet_replica.cc:330] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b: stopping tablet replica
I20260809 02:21:54.002135 26798 raft_consensus.cc:2229] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:21:54.002241 26798 raft_consensus.cc:2258] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:54.002506 26796 ts_tablet_manager.cc:1918] T c665e76f87f54f148c0f0f76fa2a3884 P 5000f48bb66e4a52938757a3396e54ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:54.002633 26796 log.cc:1196] T c665e76f87f54f148c0f0f76fa2a3884 P 5000f48bb66e4a52938757a3396e54ec: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/c665e76f87f54f148c0f0f76fa2a3884
I20260809 02:21:54.002720 26798 ts_tablet_manager.cc:1905] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:54.003090 26796 ts_tablet_manager.cc:1939] T c665e76f87f54f148c0f0f76fa2a3884 P 5000f48bb66e4a52938757a3396e54ec: Deleting consensus metadata
I20260809 02:21:54.003607 26246 catalog_manager.cc:4841] TS 5000f48bb66e4a52938757a3396e54ec (127.11.93.131:36439): tablet c665e76f87f54f148c0f0f76fa2a3884 (table test-table [id=0a9b57bd8c1a44258e4cb4adee99f042]) successfully deleted
I20260809 02:21:54.004390 26798 ts_tablet_manager.cc:1918] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:54.004484 26798 log.cc:1196] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/c665e76f87f54f148c0f0f76fa2a3884
I20260809 02:21:54.004777 26798 ts_tablet_manager.cc:1939] T c665e76f87f54f148c0f0f76fa2a3884 P b8f7791c70404b658cb9d853720d6f7b: Deleting consensus metadata
I20260809 02:21:54.005190 26245 catalog_manager.cc:4841] TS b8f7791c70404b658cb9d853720d6f7b (127.11.93.130:40303): tablet c665e76f87f54f148c0f0f76fa2a3884 (table test-table [id=0a9b57bd8c1a44258e4cb4adee99f042]) successfully deleted
W20260809 02:21:54.006889 26246 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.93.129:34185 (error 108)
I20260809 02:21:54.007454 26765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:54.007312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:34185 (local address 127.0.0.1:60666)
0809 02:21:54.007378 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:54.007416 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.129:34185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 02:21:54.007560 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 26474
W20260809 02:21:54.007690 26246 catalog_manager.cc:4584] TS 523aaf1686164a4e821badd45f8acd8a (127.11.93.129:34185): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c665e76f87f54f148c0f0f76fa2a3884: Network error: Client connection negotiation failed: client connection to 127.11.93.129:34185: connect: Connection refused (error 111)
I20260809 02:21:54.014164 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 26616
I20260809 02:21:54.019475 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 26226
I20260809 02:21:54.026155 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:42131
--webserver_interface=127.11.93.190
--webserver_port=45511
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:40317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:42131
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:54.108338 26801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:54.108556 26801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:54.108577 26801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:54.109665 26801 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:54.109700 26801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:54.109714 26801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:54.109727 26801 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:54.109738 26801 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:21:54.111229 26801 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:40317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:42131
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:42131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=45511
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26801
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:54.111425 26801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:54.111595 26801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:54.120808 26808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:54.120860 26809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:54.121099 26801 server_base.cc:1034] running on GCE node
W20260809 02:21:54.120812 26811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:54.121426 26801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:54.121749 26801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:54.122913 26801 hybrid_clock.cc:648] HybridClock initialized: now 1786242114122898 us; error 43 us; skew 500 ppm
Aug 09 02:21:54 dist-test-slave-w206 krb5kdc[26211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242114, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:54.125595 26801 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:21:54.126076 26801 webserver.cc:460] Webserver started at http://127.11.93.190:45511/ using document root <none> and password file <none>
I20260809 02:21:54.126288 26801 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:54.126341 26801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:54.127737 26801 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260809 02:21:54.128368 26818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:54.128567 26801 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:21:54.128655 26801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "9798651cded844258807b2be2aefac90"
format_stamp: "Formatted at 2026-08-09 02:21:53 on dist-test-slave-w206"
server_key: "ff3ad632da0c579622bd0bac489f7b1a"
server_key_iv: "b191315ea1aa2425f3cf24946879320f"
server_key_version: "encryptionkey@0"
I20260809 02:21:54.129029 26801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:54.148439 26801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:54.150292 26801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:54.150415 26801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:54.154654 26801 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:42131
I20260809 02:21:54.154728 26875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:42131 every 8 connection(s)
I20260809 02:21:54.155155 26801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:21:54.156919 26876 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:21:54.157611 26876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90: Bootstrap starting.
I20260809 02:21:54.161846 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 26801
I20260809 02:21:54.162192 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:34185
--local_ip_for_outbound_sockets=127.11.93.129
--tserver_master_addrs=127.11.93.190:42131
--webserver_port=37627
--webserver_interface=127.11.93.129
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:40317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:21:54.166365 26876 log.cc:824] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:54.168483 26876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:21:54.168789 26876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90: Bootstrap complete.
I20260809 02:21:54.171181 26876 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798651cded844258807b2be2aefac90" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42131 } }
I20260809 02:21:54.171435 26876 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9798651cded844258807b2be2aefac90, State: Initialized, Role: FOLLOWER
I20260809 02:21:54.171617 26876 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798651cded844258807b2be2aefac90" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42131 } }
I20260809 02:21:54.171697 26876 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:21:54.171754 26876 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:21:54.171806 26876 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 1 FOLLOWER]: Advancing to term 2
I20260809 02:21:54.172817 26876 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798651cded844258807b2be2aefac90" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42131 } }
I20260809 02:21:54.172947 26876 leader_election.cc:302] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9798651cded844258807b2be2aefac90; no voters:
I20260809 02:21:54.173154 26876 leader_election.cc:288] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 02:21:54.173202 26880 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 02:21:54.173322 26880 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 2 LEADER]: Becoming Leader. State: Replica: 9798651cded844258807b2be2aefac90, State: Running, Role: LEADER
I20260809 02:21:54.173444 26876 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:54.173429 26880 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798651cded844258807b2be2aefac90" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42131 } }
I20260809 02:21:54.173717 26880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9798651cded844258807b2be2aefac90. Latest consensus state: current_term: 2 leader_uuid: "9798651cded844258807b2be2aefac90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798651cded844258807b2be2aefac90" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42131 } } }
I20260809 02:21:54.173796 26880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:54.173722 26882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9798651cded844258807b2be2aefac90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798651cded844258807b2be2aefac90" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42131 } } }
I20260809 02:21:54.173959 26882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:54.174013 26885 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:21:54.174875 26885 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:21:54.174997 26885 catalog_manager.cc:1259] Loaded cluster ID: da9958194b0c4e3f8867cf34d83c0b57
I20260809 02:21:54.175029 26885 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:21:54.175328 26885 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260809 02:21:54.178129 26885 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260809 02:21:54.180058 26885 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:21:54.180296 26885 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90: Loaded TSK: 0
I20260809 02:21:54.180550 26885 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 02:21:54.272775 26878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:54.272989 26878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:54.273013 26878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:54.274296 26878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:54.274366 26878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:54.274410 26878 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:21:54.275955 26878 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:40317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:34185
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=37627
--tserver_master_addrs=127.11.93.190:42131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26878
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:54.276235 26878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:54.276469 26878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:54.282409 26908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:54.282409 26905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:54.282526 26878 server_base.cc:1034] running on GCE node
W20260809 02:21:54.282632 26904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:54.282830 26878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:54.283160 26878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:54.284314 26878 hybrid_clock.cc:648] HybridClock initialized: now 1786242114284302 us; error 30 us; skew 500 ppm
Aug 09 02:21:54 dist-test-slave-w206 krb5kdc[26211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242114, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:54.287038 26878 init.cc:377] Logged in from keytab as kudu/127.11.93.129@KRBTEST.COM (short username kudu)
I20260809 02:21:54.287577 26878 webserver.cc:460] Webserver started at http://127.11.93.129:37627/ using document root <none> and password file <none>
I20260809 02:21:54.287834 26878 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:54.287927 26878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:54.289287 26878 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:21:54.290010 26915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:54.290184 26878 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:54.290288 26878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "523aaf1686164a4e821badd45f8acd8a"
format_stamp: "Formatted at 2026-08-09 02:21:53 on dist-test-slave-w206"
server_key: "86ab643613b4c298dd78395c825d73e8"
server_key_iv: "344f8c7dd453b143ba84471e4eb40c35"
server_key_version: "encryptionkey@0"
I20260809 02:21:54.290633 26878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:54.297577 26878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:54.299876 26878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:54.300037 26878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:54.300271 26878 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:54.300732 26922 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 02:21:54.302665 26878 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 02:21:54.302726 26878 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260809 02:21:54.302768 26878 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 02:21:54.303458 26878 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 02:21:54.303516 26878 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260809 02:21:54.303582 26922 tablet_bootstrap.cc:492] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a: Bootstrap starting.
I20260809 02:21:54.310839 26878 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:34185
I20260809 02:21:54.310899 27035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:34185 every 8 connection(s)
I20260809 02:21:54.311380 26878 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:21:54.315124 26922 log.cc:824] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:54.317951 26922 tablet_bootstrap.cc:492] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:21:54.318269 26922 tablet_bootstrap.cc:492] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a: Bootstrap complete.
I20260809 02:21:54.318372 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 26878
I20260809 02:21:54.318681 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:40303
--local_ip_for_outbound_sockets=127.11.93.130
--tserver_master_addrs=127.11.93.190:42131
--webserver_port=41655
--webserver_interface=127.11.93.130
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:40317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:21:54.319521 26922 ts_tablet_manager.cc:1397] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.010s
I20260809 02:21:54.321235 26922 raft_consensus.cc:348] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:54.321568 26922 raft_consensus.cc:729] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523aaf1686164a4e821badd45f8acd8a, State: Initialized, Role: FOLLOWER
Aug 09 02:21:54 dist-test-slave-w206 krb5kdc[26211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242114, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:21:54.321750 26922 consensus_queue.cc:260] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:54.322042 26922 ts_tablet_manager.cc:1428] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260809 02:21:54.326745 27039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:54.312147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.129:51991)
0809 02:21:54.312329 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:54.312379 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:54.313163 (+ 784us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:54.315600 (+ 2437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:54.315604 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:54.315930 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:54.316112 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:54.316117 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.317395 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.317397 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:54.318407 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:54.318410 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.319340 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.319342 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:54.319500 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:54.320309 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:54.320319 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:54.322128 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:54.324699 (+ 2571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:54.324706 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:54.324708 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:54.325038 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:54.325393 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:54.325394 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:54.325394 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:54.325544 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:54.326066 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:54.326073 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:54.326223 (+ 150us) client_negotiation.cc:769] Sending connection context
0809 02:21:54.326359 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 02:21:54.326545 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":99,"threads_started":1}
I20260809 02:21:54.327263 27040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:54.312291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:51991 (local address 127.11.93.190:42131)
0809 02:21:54.315123 (+ 2832us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:54.315132 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:54.315178 (+ 46us) server_negotiation.cc:407] Connection header received
0809 02:21:54.315326 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:54.315333 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:54.315393 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:54.315553 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:54.316248 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.317276 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.318523 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.319208 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.319809 (+ 601us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:54.322241 (+ 2432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:54.322246 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:54.322246 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:54.322259 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:54.324597 (+ 2338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:54.325141 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:54.325144 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:54.325145 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:54.325287 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:54.325627 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:54.325628 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:54.325628 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:54.325961 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:54.326045 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:54.326463 (+ 418us) server_negotiation.cc:299] Negotiation successful
0809 02:21:54.326620 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2777,"thread_start_us":96,"threads_started":1}
I20260809 02:21:54.328024 27036 heartbeater.cc:347] Connected to a master server at 127.11.93.190:42131
I20260809 02:21:54.328127 27036 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:54.328321 27036 heartbeater.cc:511] Master 127.11.93.190:42131 requested a full tablet report, sending...
I20260809 02:21:54.329241 26837 ts_manager.cc:194] Registered new tserver with Master: 523aaf1686164a4e821badd45f8acd8a (127.11.93.129:34185)
I20260809 02:21:54.330555 26837 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:51991
I20260809 02:21:54.331715 27036 heartbeater.cc:503] Master 127.11.93.190:42131 was elected leader, sending a full tablet report...
I20260809 02:21:54.335666 27044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:54.329954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:34185 (local address 127.0.0.1:60672)
0809 02:21:54.331106 (+ 1152us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:54.331141 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:54.331227 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:54.331650 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:54.331653 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:54.331655 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:54.331761 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:54.331762 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.333131 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.333132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:54.334407 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:54.334410 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.335321 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.335322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:54.335421 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:54.335435 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 02:21:54.335524 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 02:21:54.335575 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1124,"thread_start_us":112,"threads_started":1}
I20260809 02:21:54.336237 27045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:54.330216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60672 (local address 127.11.93.129:34185)
0809 02:21:54.331347 (+ 1131us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:54.331351 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:54.331360 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:21:54.331394 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:54.331396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:54.331551 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:54.331909 (+ 358us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:54.331953 (+ 44us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.333036 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.334510 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.335220 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.336042 (+ 822us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:54.336104 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:54.336129 (+ 25us) server_negotiation.cc:299] Negotiation successful
0809 02:21:54.336170 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1100,"thread_start_us":69,"threads_started":1}
I20260809 02:21:54.336740 26967 tablet_service.cc:1514] Processing DeleteTablet for tablet c665e76f87f54f148c0f0f76fa2a3884 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:53 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:60672
I20260809 02:21:54.337427 27046 tablet_replica.cc:330] stopping tablet replica
I20260809 02:21:54.337543 27046 raft_consensus.cc:2229] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:21:54.337607 27046 raft_consensus.cc:2258] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:54.337978 27046 ts_tablet_manager.cc:1905] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:54.340289 27046 ts_tablet_manager.cc:1918] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:54.340365 27046 log.cc:1196] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/wal/wals/c665e76f87f54f148c0f0f76fa2a3884
I20260809 02:21:54.340596 27046 ts_tablet_manager.cc:1939] T c665e76f87f54f148c0f0f76fa2a3884 P 523aaf1686164a4e821badd45f8acd8a: Deleting consensus metadata
I20260809 02:21:54.341215 26820 catalog_manager.cc:4841] TS 523aaf1686164a4e821badd45f8acd8a (127.11.93.129:34185): tablet c665e76f87f54f148c0f0f76fa2a3884 (table test-table [id=0a9b57bd8c1a44258e4cb4adee99f042]) successfully deleted
W20260809 02:21:54.407289 27042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:54.407481 27042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:54.407505 27042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:54.408563 27042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:54.408599 27042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:54.408625 27042 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:21:54.409971 27042 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:40317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:40303
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=41655
--tserver_master_addrs=127.11.93.190:42131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27042
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:54.410147 27042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:54.410319 27042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:54.415544 27051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:54.415654 27052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:54.415884 27054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:54.416952 27042 server_base.cc:1034] running on GCE node
I20260809 02:21:54.417196 27042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:54.417474 27042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:54.418627 27042 hybrid_clock.cc:648] HybridClock initialized: now 1786242114418616 us; error 27 us; skew 500 ppm
Aug 09 02:21:54 dist-test-slave-w206 krb5kdc[26211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242114, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:54.421404 27042 init.cc:377] Logged in from keytab as kudu/127.11.93.130@KRBTEST.COM (short username kudu)
I20260809 02:21:54.421857 27042 webserver.cc:460] Webserver started at http://127.11.93.130:41655/ using document root <none> and password file <none>
I20260809 02:21:54.422086 27042 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:54.422143 27042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:54.423712 27042 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:21:54.424389 27061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:54.424613 27042 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:21:54.424717 27042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "b8f7791c70404b658cb9d853720d6f7b"
format_stamp: "Formatted at 2026-08-09 02:21:53 on dist-test-slave-w206"
server_key: "8d7fc83d0f784006db2865faca194297"
server_key_iv: "e64c6eb250d771d29593698a5235ec04"
server_key_version: "encryptionkey@0"
I20260809 02:21:54.425083 27042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:54.435688 27042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:54.437916 27042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:54.438076 27042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:54.438308 27042 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:54.438608 27042 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:54.438663 27042 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:54.438697 27042 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:54.438724 27042 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:54.444517 27042 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:40303
I20260809 02:21:54.444555 27187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:40303 every 8 connection(s)
I20260809 02:21:54.444912 27042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:21:54.446823 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 27042
I20260809 02:21:54.447151 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:36439
--local_ip_for_outbound_sockets=127.11.93.131
--tserver_master_addrs=127.11.93.190:42131
--webserver_port=39417
--webserver_interface=127.11.93.131
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:40317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:21:54 dist-test-slave-w206 krb5kdc[26211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242114, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:21:54.455734 27191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:54.445680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.130:44357)
0809 02:21:54.445861 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:54.445895 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:54.446345 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:54.446575 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:54.446578 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:54.447212 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:54.447467 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:54.447474 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.448435 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.448436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:54.449481 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:54.449484 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.449933 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.449934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:54.450084 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:54.450596 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:54.450607 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:54.452317 (+ 1710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:54.454347 (+ 2030us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:54.454359 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:54.454361 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:54.454582 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:54.454825 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:54.454826 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:54.454826 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:54.454926 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:54.455249 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:54.455254 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:54.455374 (+ 120us) client_negotiation.cc:769] Sending connection context
0809 02:21:54.455459 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 02:21:54.455575 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":97,"threads_started":1}
I20260809 02:21:54.455765 27040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:54.445680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:44357 (local address 127.11.93.190:42131)
0809 02:21:54.445727 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:54.445730 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:54.445978 (+ 248us) server_negotiation.cc:407] Connection header received
0809 02:21:54.446434 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:54.446435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:54.446450 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:54.446504 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:54.447577 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.448337 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.449591 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.449840 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.449902 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:54.452425 (+ 2523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:54.452427 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:54.452428 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:54.452436 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:54.454256 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:54.454664 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:54.454666 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:54.454666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:54.454753 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:54.455015 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:54.455016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:54.455017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:54.455176 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:54.455256 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:54.455510 (+ 254us) server_negotiation.cc:299] Negotiation successful
0809 02:21:54.455613 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 02:21:54.456310 27188 heartbeater.cc:347] Connected to a master server at 127.11.93.190:42131
I20260809 02:21:54.456421 27188 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:54.456636 27188 heartbeater.cc:511] Master 127.11.93.190:42131 requested a full tablet report, sending...
I20260809 02:21:54.457067 26837 ts_manager.cc:194] Registered new tserver with Master: b8f7791c70404b658cb9d853720d6f7b (127.11.93.130:40303)
I20260809 02:21:54.457444 26837 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:44357
W20260809 02:21:54.534813 27192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:54.535081 27192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:54.535109 27192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:54.536276 27192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:54.536320 27192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:54.536374 27192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:21:54.537811 27192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:40317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:36439
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=39417
--tserver_master_addrs=127.11.93.190:42131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27192
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:54.538048 27192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:54.538278 27192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:54.543282 27198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:54.543308 27197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:54.543306 27200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:54.543569 27192 server_base.cc:1034] running on GCE node
I20260809 02:21:54.543792 27192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:54.544026 27192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:54.545164 27192 hybrid_clock.cc:648] HybridClock initialized: now 1786242114545155 us; error 27 us; skew 500 ppm
Aug 09 02:21:54 dist-test-slave-w206 krb5kdc[26211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242114, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:54.547746 27192 init.cc:377] Logged in from keytab as kudu/127.11.93.131@KRBTEST.COM (short username kudu)
I20260809 02:21:54.548179 27192 webserver.cc:460] Webserver started at http://127.11.93.131:39417/ using document root <none> and password file <none>
I20260809 02:21:54.548411 27192 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:54.548485 27192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:54.549840 27192 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:21:54.550429 27208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:54.550594 27192 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:21:54.550700 27192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "5000f48bb66e4a52938757a3396e54ec"
format_stamp: "Formatted at 2026-08-09 02:21:53 on dist-test-slave-w206"
server_key: "8eed2eac5ef3dbac32503e7eba4ca2cf"
server_key_iv: "300dd71922b151d8ff26631868e77273"
server_key_version: "encryptionkey@0"
I20260809 02:21:54.551107 27192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:54.560514 27192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:54.562318 27192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:54.562475 27192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:54.562716 27192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:54.563081 27192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:54.563133 27192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:54.563174 27192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:54.563200 27192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:54.568867 27192 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:36439
I20260809 02:21:54.568967 27326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:36439 every 8 connection(s)
I20260809 02:21:54.569310 27192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:21:54.574327 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 27192
Aug 09 02:21:54 dist-test-slave-w206 krb5kdc[26211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242114, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:21:54.579303 27040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:54.570060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:50297 (local address 127.11.93.190:42131)
0809 02:21:54.570133 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:54.570135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:54.570335 (+ 200us) server_negotiation.cc:407] Connection header received
0809 02:21:54.570813 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:54.570814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:54.570824 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:54.570885 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:54.571898 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.572383 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.573380 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.573564 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.573618 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:54.576374 (+ 2756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:54.576376 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:54.576376 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:54.576383 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:54.577845 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:54.578276 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:54.578278 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:54.578278 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:54.578339 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:54.578595 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:54.578596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:54.578596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:54.578707 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:54.578784 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:54.579127 (+ 343us) server_negotiation.cc:299] Negotiation successful
0809 02:21:54.579210 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:21:54.579484 27329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:54.570033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.131:50297)
0809 02:21:54.570207 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:54.570249 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:54.570731 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:54.570959 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:54.570963 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:54.571600 (+ 637us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:54.571790 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:54.571795 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.572460 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.572461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:54.573306 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:54.573308 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.573633 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.573634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:54.573727 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:54.574311 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:54.574319 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:54.576271 (+ 1952us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:54.577924 (+ 1653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:54.577932 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:54.577934 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:54.578194 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:54.578415 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:54.578415 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:54.578416 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:54.578524 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:54.578776 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:54.578783 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:54.578926 (+ 143us) client_negotiation.cc:769] Sending connection context
0809 02:21:54.579101 (+ 175us) client_negotiation.cc:240] Negotiation successful
0809 02:21:54.579259 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":106,"threads_started":1}
I20260809 02:21:54.580221 27327 heartbeater.cc:347] Connected to a master server at 127.11.93.190:42131
I20260809 02:21:54.580318 27327 heartbeater.cc:464] Registering TS with master...
I20260809 02:21:54.580509 27327 heartbeater.cc:511] Master 127.11.93.190:42131 requested a full tablet report, sending...
I20260809 02:21:54.580921 26837 ts_manager.cc:194] Registered new tserver with Master: 5000f48bb66e4a52938757a3396e54ec (127.11.93.131:36439)
I20260809 02:21:54.581328 26837 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:50297
I20260809 02:21:54.582593 27331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:54.574751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59202 (local address 127.11.93.190:42131)
0809 02:21:54.574884 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:54.574886 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:54.574925 (+ 39us) server_negotiation.cc:407] Connection header received
0809 02:21:54.574997 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:54.574998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:54.575012 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:54.575088 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:54.575805 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.576507 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.577699 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.577922 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.577996 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:54.579198 (+ 1202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:54.579199 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:54.579199 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:54.579206 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:54.580991 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:54.581786 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:54.581787 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:54.581788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:54.581852 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:54.582064 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:54.582065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:54.582066 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:54.582207 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:54.582374 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:54.582407 (+ 33us) server_negotiation.cc:299] Negotiation successful
0809 02:21:54.582469 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":71,"threads_started":1}
I20260809 02:21:54.583304 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:21:54.586117 27331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:54.583660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59218 (local address 127.11.93.190:42131)
0809 02:21:54.583714 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:54.583716 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:54.583822 (+ 106us) server_negotiation.cc:407] Connection header received
0809 02:21:54.583903 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:54.583904 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:54.583939 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:54.584016 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:21:54.584137 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.584587 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.585340 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.585555 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.585632 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:54.585797 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:21:54.585899 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:21:54.585983 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:54.586023 (+ 40us) server_negotiation.cc:299] Negotiation successful
0809 02:21:54.586045 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 02:21:54.586382 26837 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:59218:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:21:54.588047 26837 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:21:54.590308 26967 tablet_service.cc:1467] Processing CreateTablet for tablet dba74148fc9d4851b996ebe65003ff76 (DEFAULT_TABLE table=test-table [id=3ea5774081bb47d9a39de571de0b16e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:54.590536 26967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dba74148fc9d4851b996ebe65003ff76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:54.591970 26922 tablet_bootstrap.cc:492] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a: Bootstrap starting.
I20260809 02:21:54.592330 26922 tablet_bootstrap.cc:654] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:54.592922 26922 tablet_bootstrap.cc:492] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a: No bootstrap required, opened a new log
I20260809 02:21:54.592974 26922 ts_tablet_manager.cc:1397] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 02:21:54.593070 26922 raft_consensus.cc:348] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:54.593138 26922 raft_consensus.cc:374] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:54.593185 26922 raft_consensus.cc:729] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523aaf1686164a4e821badd45f8acd8a, State: Initialized, Role: FOLLOWER
I20260809 02:21:54.593225 26922 consensus_queue.cc:260] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:54.593305 26922 ts_tablet_manager.cc:1428] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:54.594560 27334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:54.590103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47490 (local address 127.11.93.131:36439)
0809 02:21:54.590254 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:54.590259 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:54.590271 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:21:54.590312 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:54.590314 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:54.590330 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:54.590615 (+ 285us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:54.590683 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.591804 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.593539 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.594225 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.594286 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:54.594330 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:54.594447 (+ 117us) server_negotiation.cc:299] Negotiation successful
0809 02:21:54.594482 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":89,"threads_started":1}
I20260809 02:21:54.594560 27336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:54.590131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40312 (local address 127.11.93.130:40303)
0809 02:21:54.590342 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:54.590347 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:54.590373 (+ 26us) server_negotiation.cc:407] Connection header received
0809 02:21:54.590415 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:54.590417 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:54.590433 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:54.590512 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:54.590780 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.591892 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.593421 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.594162 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.594245 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:54.594312 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:54.594426 (+ 114us) server_negotiation.cc:299] Negotiation successful
0809 02:21:54.594472 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":105,"threads_started":1}
I20260809 02:21:54.594558 27044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:54.589925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:36439 (local address 127.0.0.1:47490)
0809 02:21:54.589986 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:54.589998 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:54.590043 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:54.590454 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:54.590455 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:54.590456 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:54.590509 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:54.590510 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.591910 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.591911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:54.593068 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:54.593071 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.594307 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.594308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:54.594357 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:54.594360 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:21:54.594428 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 02:21:54.594458 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":155}
I20260809 02:21:54.594560 27333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:54.589926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:40303 (local address 127.0.0.1:40312)
0809 02:21:54.590282 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:54.590292 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:54.590342 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:54.590594 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:54.590595 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:54.590597 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:54.590697 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:54.590700 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.592014 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.592015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:54.593315 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:54.593318 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.594243 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.594244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:54.594328 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:54.594332 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:21:54.594408 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 02:21:54.594458 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"mutex_wait_us":25,"thread_start_us":84,"threads_started":1}
I20260809 02:21:54.595367 27258 tablet_service.cc:1467] Processing CreateTablet for tablet dba74148fc9d4851b996ebe65003ff76 (DEFAULT_TABLE table=test-table [id=3ea5774081bb47d9a39de571de0b16e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:54.595546 27117 tablet_service.cc:1467] Processing CreateTablet for tablet dba74148fc9d4851b996ebe65003ff76 (DEFAULT_TABLE table=test-table [id=3ea5774081bb47d9a39de571de0b16e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:21:54.595705 27258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dba74148fc9d4851b996ebe65003ff76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:54.595882 27117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dba74148fc9d4851b996ebe65003ff76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:21:54.598332 27338 tablet_bootstrap.cc:492] T dba74148fc9d4851b996ebe65003ff76 P 5000f48bb66e4a52938757a3396e54ec: Bootstrap starting.
I20260809 02:21:54.598582 27339 tablet_bootstrap.cc:492] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b: Bootstrap starting.
I20260809 02:21:54.599206 27338 tablet_bootstrap.cc:654] T dba74148fc9d4851b996ebe65003ff76 P 5000f48bb66e4a52938757a3396e54ec: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:54.599316 27339 tablet_bootstrap.cc:654] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b: Neither blocks nor log segments found. Creating new log.
I20260809 02:21:54.599695 27338 log.cc:824] T dba74148fc9d4851b996ebe65003ff76 P 5000f48bb66e4a52938757a3396e54ec: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:54.599782 27339 log.cc:824] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:54.600477 27338 tablet_bootstrap.cc:492] T dba74148fc9d4851b996ebe65003ff76 P 5000f48bb66e4a52938757a3396e54ec: No bootstrap required, opened a new log
I20260809 02:21:54.600533 27338 ts_tablet_manager.cc:1397] T dba74148fc9d4851b996ebe65003ff76 P 5000f48bb66e4a52938757a3396e54ec: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:54.600667 27339 tablet_bootstrap.cc:492] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b: No bootstrap required, opened a new log
I20260809 02:21:54.600814 27339 ts_tablet_manager.cc:1397] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:54.602011 27338 raft_consensus.cc:348] T dba74148fc9d4851b996ebe65003ff76 P 5000f48bb66e4a52938757a3396e54ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:54.602138 27338 raft_consensus.cc:374] T dba74148fc9d4851b996ebe65003ff76 P 5000f48bb66e4a52938757a3396e54ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:54.602161 27338 raft_consensus.cc:729] T dba74148fc9d4851b996ebe65003ff76 P 5000f48bb66e4a52938757a3396e54ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5000f48bb66e4a52938757a3396e54ec, State: Initialized, Role: FOLLOWER
I20260809 02:21:54.602286 27338 consensus_queue.cc:260] T dba74148fc9d4851b996ebe65003ff76 P 5000f48bb66e4a52938757a3396e54ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:54.602206 27339 raft_consensus.cc:348] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:54.602385 27339 raft_consensus.cc:374] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:21:54.602437 27339 raft_consensus.cc:729] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8f7791c70404b658cb9d853720d6f7b, State: Initialized, Role: FOLLOWER
I20260809 02:21:54.602578 27338 ts_tablet_manager.cc:1428] T dba74148fc9d4851b996ebe65003ff76 P 5000f48bb66e4a52938757a3396e54ec: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:54.602607 27327 heartbeater.cc:503] Master 127.11.93.190:42131 was elected leader, sending a full tablet report...
I20260809 02:21:54.602557 27339 consensus_queue.cc:260] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:54.602840 27339 ts_tablet_manager.cc:1428] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:21:54.602871 27188 heartbeater.cc:503] Master 127.11.93.190:42131 was elected leader, sending a full tablet report...
I20260809 02:21:54.634037 27343 raft_consensus.cc:482] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:21:54.634148 27343 raft_consensus.cc:504] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:54.634490 27343 leader_election.cc:288] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5000f48bb66e4a52938757a3396e54ec (127.11.93.131:36439), 523aaf1686164a4e821badd45f8acd8a (127.11.93.129:34185)
I20260809 02:21:54.637331 27334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:54.634735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:33531 (local address 127.11.93.131:36439)
0809 02:21:54.634805 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:54.634807 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:54.634818 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:21:54.634847 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:54.634848 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:54.634859 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:54.634963 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:54.635200 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.635672 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.636590 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.636965 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.637057 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:54.637065 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:54.637230 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 02:21:54.637270 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 02:21:54.637331 27191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:54.634659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:36439 (local address 127.11.93.130:33531)
0809 02:21:54.634715 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:54.634728 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:54.634770 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:54.635044 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:54.635045 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:54.635047 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:54.635117 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:54.635119 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.635760 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.635761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:54.636492 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:54.636494 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.637056 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.637057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:54.637142 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:54.637146 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:21:54.637212 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 02:21:54.637255 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 02:21:54.637817 27045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:54.634897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:45589 (local address 127.11.93.129:34185)
0809 02:21:54.634953 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:54.634955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:54.635070 (+ 115us) server_negotiation.cc:407] Connection header received
0809 02:21:54.635132 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:54.635133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:54.635142 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:54.635197 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:21:54.635353 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.635808 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.636866 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.637265 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.637356 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:54.637364 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:54.637670 (+ 306us) server_negotiation.cc:299] Negotiation successful
0809 02:21:54.637739 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 02:21:54.637820 27344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:54.634791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:34185 (local address 127.11.93.130:45589)
0809 02:21:54.635002 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:54.635014 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:54.635074 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:54.635201 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:54.635202 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:54.635203 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:21:54.635278 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:54.635279 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.635894 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.635895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:54.636689 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:54.636691 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.637355 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.637356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:54.637583 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:54.637587 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:21:54.637649 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 02:21:54.637714 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":117,"threads_started":1}
I20260809 02:21:54.637950 27281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dba74148fc9d4851b996ebe65003ff76" candidate_uuid: "b8f7791c70404b658cb9d853720d6f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5000f48bb66e4a52938757a3396e54ec" is_pre_election: true
I20260809 02:21:54.638095 27281 raft_consensus.cc:2454] T dba74148fc9d4851b996ebe65003ff76 P 5000f48bb66e4a52938757a3396e54ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8f7791c70404b658cb9d853720d6f7b in term 0.
I20260809 02:21:54.638286 27064 leader_election.cc:302] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5000f48bb66e4a52938757a3396e54ec, b8f7791c70404b658cb9d853720d6f7b; no voters:
I20260809 02:21:54.638464 27343 raft_consensus.cc:2781] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:21:54.638537 27343 raft_consensus.cc:482] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:21:54.638576 27343 raft_consensus.cc:3037] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:54.638644 26987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dba74148fc9d4851b996ebe65003ff76" candidate_uuid: "b8f7791c70404b658cb9d853720d6f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523aaf1686164a4e821badd45f8acd8a" is_pre_election: true
I20260809 02:21:54.638835 26987 raft_consensus.cc:2454] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8f7791c70404b658cb9d853720d6f7b in term 0.
I20260809 02:21:54.639459 27343 raft_consensus.cc:504] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:54.639593 27343 leader_election.cc:288] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b [CANDIDATE]: Term 1 election: Requested vote from peers 5000f48bb66e4a52938757a3396e54ec (127.11.93.131:36439), 523aaf1686164a4e821badd45f8acd8a (127.11.93.129:34185)
I20260809 02:21:54.639742 27281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dba74148fc9d4851b996ebe65003ff76" candidate_uuid: "b8f7791c70404b658cb9d853720d6f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5000f48bb66e4a52938757a3396e54ec"
I20260809 02:21:54.639812 26987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dba74148fc9d4851b996ebe65003ff76" candidate_uuid: "b8f7791c70404b658cb9d853720d6f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "523aaf1686164a4e821badd45f8acd8a"
I20260809 02:21:54.639844 27281 raft_consensus.cc:3037] T dba74148fc9d4851b996ebe65003ff76 P 5000f48bb66e4a52938757a3396e54ec [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:54.639884 26987 raft_consensus.cc:3037] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:21:54.640790 26987 raft_consensus.cc:2454] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8f7791c70404b658cb9d853720d6f7b in term 1.
I20260809 02:21:54.640846 27281 raft_consensus.cc:2454] T dba74148fc9d4851b996ebe65003ff76 P 5000f48bb66e4a52938757a3396e54ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8f7791c70404b658cb9d853720d6f7b in term 1.
I20260809 02:21:54.640946 27064 leader_election.cc:302] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 523aaf1686164a4e821badd45f8acd8a, b8f7791c70404b658cb9d853720d6f7b; no voters:
I20260809 02:21:54.641052 27343 raft_consensus.cc:2781] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:21:54.641209 27343 raft_consensus.cc:686] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b [term 1 LEADER]: Becoming Leader. State: Replica: b8f7791c70404b658cb9d853720d6f7b, State: Running, Role: LEADER
I20260809 02:21:54.641305 27343 consensus_queue.cc:237] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:54.642113 26835 catalog_manager.cc:5495] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b reported cstate change: term changed from 0 to 1, leader changed from <none> to b8f7791c70404b658cb9d853720d6f7b (127.11.93.130). New cstate: current_term: 1 leader_uuid: "b8f7791c70404b658cb9d853720d6f7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260809 02:21:54.656898 27336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:54.654723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40320 (local address 127.11.93.130:40303)
0809 02:21:54.654772 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:54.654774 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:54.654781 (+ 7us) server_negotiation.cc:407] Connection header received
0809 02:21:54.654908 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:54.654909 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:54.654929 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:54.655021 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:21:54.655156 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.655593 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.656281 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:54.656453 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:54.656501 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:54.656627 (+ 126us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:21:54.656713 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:21:54.656767 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:54.656801 (+ 34us) server_negotiation.cc:299] Negotiation successful
0809 02:21:54.656815 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 02:21:54.658601 27281 raft_consensus.cc:1261] T dba74148fc9d4851b996ebe65003ff76 P 5000f48bb66e4a52938757a3396e54ec [term 1 FOLLOWER]: Refusing update from remote peer b8f7791c70404b658cb9d853720d6f7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:54.658612 26987 raft_consensus.cc:1261] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Refusing update from remote peer b8f7791c70404b658cb9d853720d6f7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:21:54.658943 27343 consensus_queue.cc:1035] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:54.659096 27346 consensus_queue.cc:1035] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:21:54.662096 27349 mvcc.cc:205] Tried to move back new op lower bound from 7316447701639069696 to 7316447701571551232. Current Snapshot: MvccSnapshot[applied={T|T < 7316447701639069696}]
I20260809 02:21:54.662323 27350 mvcc.cc:205] Tried to move back new op lower bound from 7316447701639069696 to 7316447701571551232. Current Snapshot: MvccSnapshot[applied={T|T < 7316447701639069696 or (T in {7316447701639069696})}]
I20260809 02:21:54.663450 26837 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:59218:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:54.663547 26837 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:59218:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:21:54.664227 26837 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90: Sending DeleteTablet for 3 replicas of tablet dba74148fc9d4851b996ebe65003ff76
I20260809 02:21:54.664532 27117 tablet_service.cc:1514] Processing DeleteTablet for tablet dba74148fc9d4851b996ebe65003ff76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:54 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:40312
I20260809 02:21:54.664557 26967 tablet_service.cc:1514] Processing DeleteTablet for tablet dba74148fc9d4851b996ebe65003ff76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:54 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:60672
I20260809 02:21:54.664588 27258 tablet_service.cc:1514] Processing DeleteTablet for tablet dba74148fc9d4851b996ebe65003ff76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:21:54 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:47490
I20260809 02:21:54.664645 27046 tablet_replica.cc:330] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a: stopping tablet replica
I20260809 02:21:54.664695 27046 raft_consensus.cc:2229] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:21:54.664738 27046 raft_consensus.cc:2258] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:54.664736 27358 tablet_replica.cc:330] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b: stopping tablet replica
I20260809 02:21:54.664817 27358 raft_consensus.cc:2229] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:21:54.664916 27358 raft_consensus.cc:2258] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:54.665026 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 26878
I20260809 02:21:54.665138 27046 ts_tablet_manager.cc:1905] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:54.665346 27358 ts_tablet_manager.cc:1905] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:54.665985 27359 tablet_replica.cc:330] T dba74148fc9d4851b996ebe65003ff76 P 5000f48bb66e4a52938757a3396e54ec: stopping tablet replica
I20260809 02:21:54.666095 27359 raft_consensus.cc:2229] T dba74148fc9d4851b996ebe65003ff76 P 5000f48bb66e4a52938757a3396e54ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:21:54.666222 27359 raft_consensus.cc:2258] T dba74148fc9d4851b996ebe65003ff76 P 5000f48bb66e4a52938757a3396e54ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:21:54.666893 27359 ts_tablet_manager.cc:1905] T dba74148fc9d4851b996ebe65003ff76 P 5000f48bb66e4a52938757a3396e54ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:21:54.667626 27358 ts_tablet_manager.cc:1918] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:54.667692 27358 log.cc:1196] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/dba74148fc9d4851b996ebe65003ff76
I20260809 02:21:54.667997 27358 ts_tablet_manager.cc:1939] T dba74148fc9d4851b996ebe65003ff76 P b8f7791c70404b658cb9d853720d6f7b: Deleting consensus metadata
I20260809 02:21:54.668372 26819 catalog_manager.cc:4841] TS b8f7791c70404b658cb9d853720d6f7b (127.11.93.130:40303): tablet dba74148fc9d4851b996ebe65003ff76 (table test-table [id=3ea5774081bb47d9a39de571de0b16e0]) successfully deleted
I20260809 02:21:54.668881 27359 ts_tablet_manager.cc:1918] T dba74148fc9d4851b996ebe65003ff76 P 5000f48bb66e4a52938757a3396e54ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:21:54.668946 27359 log.cc:1196] T dba74148fc9d4851b996ebe65003ff76 P 5000f48bb66e4a52938757a3396e54ec: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/dba74148fc9d4851b996ebe65003ff76
I20260809 02:21:54.669215 27359 ts_tablet_manager.cc:1939] T dba74148fc9d4851b996ebe65003ff76 P 5000f48bb66e4a52938757a3396e54ec: Deleting consensus metadata
I20260809 02:21:54.669657 26820 catalog_manager.cc:4841] TS 5000f48bb66e4a52938757a3396e54ec (127.11.93.131:36439): tablet dba74148fc9d4851b996ebe65003ff76 (table test-table [id=3ea5774081bb47d9a39de571de0b16e0]) successfully deleted
W20260809 02:21:54.674023 26820 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.93.129:34185 (error 108)
I20260809 02:21:54.674573 27333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:54.674450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:34185 (local address 127.0.0.1:60684)
0809 02:21:54.674497 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:54.674541 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.129:34185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260809 02:21:54.674618 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 27042
W20260809 02:21:54.674695 26820 catalog_manager.cc:4584] TS 523aaf1686164a4e821badd45f8acd8a (127.11.93.129:34185): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dba74148fc9d4851b996ebe65003ff76: Network error: Client connection negotiation failed: client connection to 127.11.93.129:34185: connect: Connection refused (error 111)
I20260809 02:21:54.680176 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 27192
I20260809 02:21:54.685706 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 26801
I20260809 02:21:54.692642 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:42131
--webserver_interface=127.11.93.190
--webserver_port=45511
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:40317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:42131
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:54.774331 27361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:54.774586 27361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:54.774626 27361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:54.775827 27361 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:21:54.775904 27361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:54.775929 27361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:54.775957 27361 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:21:54.775990 27361 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:21:54.777467 27361 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:40317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:42131
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:42131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=45511
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:54.777740 27361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:54.778010 27361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:54.782868 27366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:54.782871 27367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:54.782871 27369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:54.783170 27361 server_base.cc:1034] running on GCE node
I20260809 02:21:54.783450 27361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:54.783694 27361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:54.784835 27361 hybrid_clock.cc:648] HybridClock initialized: now 1786242114784821 us; error 29 us; skew 500 ppm
Aug 09 02:21:54 dist-test-slave-w206 krb5kdc[26211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242114, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:54.787441 27361 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:21:54.787896 27361 webserver.cc:460] Webserver started at http://127.11.93.190:45511/ using document root <none> and password file <none>
I20260809 02:21:54.788153 27361 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:54.788200 27361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:54.789546 27361 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:54.790288 27376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:54.790468 27361 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:54.790571 27361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "9798651cded844258807b2be2aefac90"
format_stamp: "Formatted at 2026-08-09 02:21:53 on dist-test-slave-w206"
server_key: "ff3ad632da0c579622bd0bac489f7b1a"
server_key_iv: "b191315ea1aa2425f3cf24946879320f"
server_key_version: "encryptionkey@0"
I20260809 02:21:54.790933 27361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:54.810600 27361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:54.813042 27361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:54.813216 27361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:54.817592 27361 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:42131
I20260809 02:21:54.817627 27435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:42131 every 8 connection(s)
I20260809 02:21:54.818022 27361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:21:54.818486 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 27361
I20260809 02:21:54.818861 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:34185
--local_ip_for_outbound_sockets=127.11.93.129
--tserver_master_addrs=127.11.93.190:42131
--webserver_port=37627
--webserver_interface=127.11.93.129
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:40317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:21:54.820524 27436 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:21:54.821259 27436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90: Bootstrap starting.
I20260809 02:21:54.829649 27436 log.cc:824] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:54.832056 27436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:21:54.832366 27436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90: Bootstrap complete.
I20260809 02:21:54.834659 27436 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798651cded844258807b2be2aefac90" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42131 } }
I20260809 02:21:54.834875 27436 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9798651cded844258807b2be2aefac90, State: Initialized, Role: FOLLOWER
I20260809 02:21:54.835081 27436 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798651cded844258807b2be2aefac90" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42131 } }
I20260809 02:21:54.835177 27436 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:21:54.835230 27436 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:21:54.835285 27436 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 2 FOLLOWER]: Advancing to term 3
I20260809 02:21:54.836283 27436 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798651cded844258807b2be2aefac90" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42131 } }
I20260809 02:21:54.836370 27436 leader_election.cc:302] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9798651cded844258807b2be2aefac90; no voters:
I20260809 02:21:54.836588 27436 leader_election.cc:288] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 02:21:54.836623 27440 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 02:21:54.836740 27440 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [term 3 LEADER]: Becoming Leader. State: Replica: 9798651cded844258807b2be2aefac90, State: Running, Role: LEADER
I20260809 02:21:54.836835 27440 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798651cded844258807b2be2aefac90" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42131 } }
I20260809 02:21:54.836865 27436 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:21:54.837126 27442 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9798651cded844258807b2be2aefac90. Latest consensus state: current_term: 3 leader_uuid: "9798651cded844258807b2be2aefac90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798651cded844258807b2be2aefac90" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42131 } } }
I20260809 02:21:54.837229 27442 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:54.837123 27441 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "9798651cded844258807b2be2aefac90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9798651cded844258807b2be2aefac90" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42131 } } }
I20260809 02:21:54.837529 27441 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9798651cded844258807b2be2aefac90 [sys.catalog]: This master's current role is: LEADER
I20260809 02:21:54.837666 27446 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:21:54.838450 27446 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:21:54.838552 27446 catalog_manager.cc:1259] Loaded cluster ID: da9958194b0c4e3f8867cf34d83c0b57
I20260809 02:21:54.838589 27446 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260809 02:21:54.838912 27446 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fc97b4479ad google::LogMessage::Fail() at ??:0
@ 0x7fc97b44a88a google::LogMessage::SendToLog() at ??:0
@ 0x7fc97b4474de google::LogMessage::Flush() at ??:0
@ 0x7fc97b448a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fc9833680f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fc9833718b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fc97d3150d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fc97d30a954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fc97e16e6db start_thread at ??:0
@ 0x7fc979f4561f clone at ??:0
W20260809 02:21:54.912593 27438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:54.912822 27438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:54.912860 27438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:54.914005 27438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:54.914064 27438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:54.914114 27438 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:21:54.915701 27438 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:40317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:34185
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=37627
--tserver_master_addrs=127.11.93.190:42131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27438
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:54.915946 27438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:54.916204 27438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:54.922194 27475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:54.922319 27476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:54.922187 27478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:54.922420 27438 server_base.cc:1034] running on GCE node
I20260809 02:21:54.922610 27438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:54.922859 27438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:54.924021 27438 hybrid_clock.cc:648] HybridClock initialized: now 1786242114924014 us; error 48 us; skew 500 ppm
Aug 09 02:21:54 dist-test-slave-w206 krb5kdc[26211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242114, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:54.926712 27438 init.cc:377] Logged in from keytab as kudu/127.11.93.129@KRBTEST.COM (short username kudu)
I20260809 02:21:54.927237 27438 webserver.cc:460] Webserver started at http://127.11.93.129:37627/ using document root <none> and password file <none>
I20260809 02:21:54.927506 27438 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:54.927577 27438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:54.928964 27438 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:54.929777 27486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:54.929960 27438 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:54.930071 27438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "523aaf1686164a4e821badd45f8acd8a"
format_stamp: "Formatted at 2026-08-09 02:21:53 on dist-test-slave-w206"
server_key: "86ab643613b4c298dd78395c825d73e8"
server_key_iv: "344f8c7dd453b143ba84471e4eb40c35"
server_key_version: "encryptionkey@0"
I20260809 02:21:54.930394 27438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:54.965137 27438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:54.967490 27438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:54.967630 27438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:54.967916 27438 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:54.968408 27493 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 02:21:54.970427 27438 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 02:21:54.970491 27438 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260809 02:21:54.970536 27438 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 02:21:54.971212 27438 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 02:21:54.971271 27438 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:54.971335 27493 tablet_bootstrap.cc:492] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a: Bootstrap starting.
I20260809 02:21:54.973207 27493 log.cc:824] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a: Log is configured to *not* fsync() on all Append() calls
I20260809 02:21:54.976346 27493 tablet_bootstrap.cc:492] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:21:54.976670 27493 tablet_bootstrap.cc:492] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a: Bootstrap complete.
I20260809 02:21:54.976845 27493 ts_tablet_manager.cc:1397] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260809 02:21:54.978452 27438 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:34185
I20260809 02:21:54.978492 27614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:34185 every 8 connection(s)
I20260809 02:21:54.978823 27438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:21:54.978742 27493 raft_consensus.cc:348] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:54.979760 27493 raft_consensus.cc:729] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523aaf1686164a4e821badd45f8acd8a, State: Initialized, Role: FOLLOWER
I20260809 02:21:54.979931 27493 consensus_queue.cc:260] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:54.980223 27493 ts_tablet_manager.cc:1428] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260809 02:21:54.985061 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 27438
I20260809 02:21:54.985348 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:40303
--local_ip_for_outbound_sockets=127.11.93.130
--tserver_master_addrs=127.11.93.190:42131
--webserver_port=41655
--webserver_interface=127.11.93.130
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:40317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:55.029141 27617 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:21:54.979540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.129:51131)
0809 02:21:54.979701 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:54.979736 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:54.979933 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:55.028928 (+ 48995us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":86,"threads_started":1}
W20260809 02:21:55.029419 27615 heartbeater.cc:644] Failed to heartbeat to 127.11.93.190:42131 (0 consecutive failures): Network error: Failed to ping master at 127.11.93.190:42131: Client connection negotiation failed: client connection to 127.11.93.190:42131: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 02:21:55.029784 27617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:55.029655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.129:49691)
0809 02:21:55.029710 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:55.029752 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 02:21:55.030109 27617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:55.030022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.129:44649)
0809 02:21:55.030066 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:55.030089 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260809 02:21:55.030261 27615 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:21:55.071902 27619 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:55.072119 27619 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:55.072158 27619 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:55.073283 27619 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:55.073349 27619 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:55.073395 27619 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:21:55.074839 27619 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:40317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:40303
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=41655
--tserver_master_addrs=127.11.93.190:42131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27619
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:55.075126 27619 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:55.075348 27619 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:55.080252 27625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:55.080253 27627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:55.080327 27624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:55.080582 27619 server_base.cc:1034] running on GCE node
I20260809 02:21:55.080818 27619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:55.081017 27619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:55.082152 27619 hybrid_clock.cc:648] HybridClock initialized: now 1786242115082131 us; error 37 us; skew 500 ppm
Aug 09 02:21:55 dist-test-slave-w206 krb5kdc[26211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242115, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:55.084702 27619 init.cc:377] Logged in from keytab as kudu/127.11.93.130@KRBTEST.COM (short username kudu)
I20260809 02:21:55.085131 27619 webserver.cc:460] Webserver started at http://127.11.93.130:41655/ using document root <none> and password file <none>
I20260809 02:21:55.085323 27619 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:55.085366 27619 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:55.086584 27619 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:55.087168 27636 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:55.087438 27619 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 02:21:55.087538 27619 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "b8f7791c70404b658cb9d853720d6f7b"
format_stamp: "Formatted at 2026-08-09 02:21:53 on dist-test-slave-w206"
server_key: "8d7fc83d0f784006db2865faca194297"
server_key_iv: "e64c6eb250d771d29593698a5235ec04"
server_key_version: "encryptionkey@0"
I20260809 02:21:55.087865 27619 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:55.098963 27619 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:55.100808 27619 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:55.100973 27619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:55.101195 27619 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:55.101491 27619 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:55.101545 27619 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:55.101585 27619 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:55.101614 27619 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:55.107600 27619 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:40303
I20260809 02:21:55.107649 27756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:40303 every 8 connection(s)
I20260809 02:21:55.107975 27619 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:21:55.108947 27760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:55.108536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.130:55287)
0809 02:21:55.108687 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:55.108800 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":70,"threads_started":1}
W20260809 02:21:55.109354 27757 heartbeater.cc:644] Failed to heartbeat to 127.11.93.190:42131 (0 consecutive failures): Network error: Failed to ping master at 127.11.93.190:42131: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
I20260809 02:21:55.109652 27760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:55.109565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.130:37755)
0809 02:21:55.109608 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:55.109634 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260809 02:21:55.109954 27760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:55.109879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.130:40979)
0809 02:21:55.109917 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:55.109939 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260809 02:21:55.110083 27757 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 02:21:55.111151 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 27619
I20260809 02:21:55.111406 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:36439
--local_ip_for_outbound_sockets=127.11.93.131
--tserver_master_addrs=127.11.93.190:42131
--webserver_port=39417
--webserver_interface=127.11.93.131
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:40317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:21:55.194619 27761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:21:55.194849 27761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:21:55.194890 27761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:21:55.196072 27761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:21:55.196141 27761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:21:55.196185 27761 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:21:55.197662 27761 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:40317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:36439
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=39417
--tserver_master_addrs=127.11.93.190:42131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:21:55.197937 27761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:21:55.198168 27761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:21:55.203249 27769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:55.203249 27767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:21:55.203316 27766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:21:55.203487 27761 server_base.cc:1034] running on GCE node
I20260809 02:21:55.203696 27761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:21:55.203943 27761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:21:55.205104 27761 hybrid_clock.cc:648] HybridClock initialized: now 1786242115205097 us; error 37 us; skew 500 ppm
Aug 09 02:21:55 dist-test-slave-w206 krb5kdc[26211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242115, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:21:55.207697 27761 init.cc:377] Logged in from keytab as kudu/127.11.93.131@KRBTEST.COM (short username kudu)
I20260809 02:21:55.208129 27761 webserver.cc:460] Webserver started at http://127.11.93.131:39417/ using document root <none> and password file <none>
I20260809 02:21:55.208376 27761 fs_manager.cc:359] Metadata directory not provided
I20260809 02:21:55.208454 27761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:21:55.209784 27761 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:21:55.210403 27776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:55.210583 27761 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:55.210680 27761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "5000f48bb66e4a52938757a3396e54ec"
format_stamp: "Formatted at 2026-08-09 02:21:53 on dist-test-slave-w206"
server_key: "8eed2eac5ef3dbac32503e7eba4ca2cf"
server_key_iv: "300dd71922b151d8ff26631868e77273"
server_key_version: "encryptionkey@0"
I20260809 02:21:55.211109 27761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:21:55.230902 27761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:21:55.232874 27761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:21:55.232996 27761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:21:55.233179 27761 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:21:55.233556 27761 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:21:55.233594 27761 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:55.233618 27761 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:21:55.233630 27761 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:21:55.239384 27761 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:36439
I20260809 02:21:55.239464 27894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:36439 every 8 connection(s)
I20260809 02:21:55.239820 27761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:21:55.240893 27897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:55.240513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.131:45827)
0809 02:21:55.240668 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:55.240744 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":73,"threads_started":1}
W20260809 02:21:55.241293 27895 heartbeater.cc:644] Failed to heartbeat to 127.11.93.190:42131 (0 consecutive failures): Network error: Failed to ping master at 127.11.93.190:42131: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
I20260809 02:21:55.241568 27897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:55.241482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.131:40259)
0809 02:21:55.241526 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:55.241551 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260809 02:21:55.241824 27897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:55.241769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.131:51037)
0809 02:21:55.241793 (+ 24us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:55.241812 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260809 02:21:55.241958 27895 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 02:21:55.247095 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 27761
I20260809 02:21:56.030881 27899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:56.030649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.129:36025)
0809 02:21:56.030784 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:56.030820 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":73,"threads_started":1}
I20260809 02:21:56.110697 27900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:56.110482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.130:48993)
0809 02:21:56.110614 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:56.110645 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":78,"threads_started":1}
I20260809 02:21:56.161931 27901 raft_consensus.cc:482] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:21:56.162065 27901 raft_consensus.cc:504] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:56.162420 27901 leader_election.cc:288] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5000f48bb66e4a52938757a3396e54ec (127.11.93.131:36439), b8f7791c70404b658cb9d853720d6f7b (127.11.93.130:40303)
Aug 09 02:21:56 dist-test-slave-w206 krb5kdc[26211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242114, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.131@KRBTEST.COM
Aug 09 02:21:56 dist-test-slave-w206 krb5kdc[26211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242114, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.130@KRBTEST.COM
I20260809 02:21:56.174084 27902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:56.162713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:52457 (local address 127.11.93.131:36439)
0809 02:21:56.162867 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:56.162881 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:56.162929 (+ 48us) server_negotiation.cc:407] Connection header received
0809 02:21:56.163513 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:56.163516 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:56.163580 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:56.163700 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:56.164621 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:56.165542 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:56.166523 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:56.166944 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:56.167111 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:56.169724 (+ 2613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:56.169728 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:56.169729 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:56.169740 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:56.171817 (+ 2077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:56.172682 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:56.172686 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:56.172686 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:56.172791 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:56.173113 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:56.173118 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:56.173119 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:56.173369 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:56.173458 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:56.173850 (+ 392us) server_negotiation.cc:299] Negotiation successful
0809 02:21:56.173968 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":66,"threads_started":1}
I20260809 02:21:56.174259 27906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:56.162854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:57263 (local address 127.11.93.130:40303)
0809 02:21:56.163047 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 02:21:56.163057 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:21:56.163093 (+ 36us) server_negotiation.cc:407] Connection header received
0809 02:21:56.163625 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:21:56.163627 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:21:56.163693 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:21:56.163839 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:21:56.164511 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:56.165422 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:56.166517 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:21:56.166933 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:21:56.167233 (+ 300us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:56.170258 (+ 3025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:21:56.170263 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:21:56.170263 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:21:56.170274 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:21:56.171985 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:56.172715 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:56.172718 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:56.172719 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:56.172844 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:21:56.173089 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:21:56.173090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:21:56.173090 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:21:56.173391 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:21:56.173477 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 02:21:56.173994 (+ 517us) server_negotiation.cc:299] Negotiation successful
0809 02:21:56.174138 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":70,"threads_started":1}
I20260809 02:21:56.174152 27899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:56.162619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:36439 (local address 127.11.93.129:52457)
0809 02:21:56.162675 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:56.162689 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:56.162758 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:56.163778 (+ 1020us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:56.163781 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:56.164403 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:56.164506 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:56.164509 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:56.165645 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:56.165646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:56.166411 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:56.166414 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:56.167127 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:56.167128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:56.167273 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:56.167994 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:56.167999 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:56.169588 (+ 1589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:56.172056 (+ 2468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:56.172067 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:56.172071 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:56.172571 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:56.172882 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:56.172883 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:56.172884 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:56.173022 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:56.173465 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:56.173472 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:56.173641 (+ 169us) client_negotiation.cc:769] Sending connection context
0809 02:21:56.173772 (+ 131us) client_negotiation.cc:240] Negotiation successful
0809 02:21:56.174011 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":75}
I20260809 02:21:56.174620 27904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:56.162627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:40303 (local address 127.11.93.129:57263)
0809 02:21:56.162938 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:56.162950 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:21:56.163026 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:21:56.163836 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:21:56.163837 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:21:56.164153 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:21:56.164356 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:56.164362 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:56.165532 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:56.165533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:56.166413 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:21:56.166415 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:21:56.167195 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:21:56.167196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:21:56.167276 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:21:56.167929 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:21:56.167938 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:21:56.169983 (+ 2045us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:21:56.172105 (+ 2122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:56.172106 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:56.172107 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:56.172599 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:56.172926 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:21:56.172927 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:21:56.172927 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:21:56.173016 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:21:56.173507 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:21:56.173508 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:21:56.173641 (+ 133us) client_negotiation.cc:769] Sending connection context
0809 02:21:56.173772 (+ 131us) client_negotiation.cc:240] Negotiation successful
0809 02:21:56.174110 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":352,"thread_start_us":47,"threads_started":1}
W20260809 02:21:56.175426 27488 leader_election.cc:341] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5000f48bb66e4a52938757a3396e54ec (127.11.93.131:36439): Not found: Tablet not found: dba74148fc9d4851b996ebe65003ff76
W20260809 02:21:56.175585 27487 leader_election.cc:341] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b8f7791c70404b658cb9d853720d6f7b (127.11.93.130:40303): Not found: Tablet not found: dba74148fc9d4851b996ebe65003ff76
I20260809 02:21:56.175655 27487 leader_election.cc:302] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 523aaf1686164a4e821badd45f8acd8a; no voters: 5000f48bb66e4a52938757a3396e54ec, b8f7791c70404b658cb9d853720d6f7b
I20260809 02:21:56.175813 27901 raft_consensus.cc:2726] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:21:56.242653 27907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:56.242418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.131:52479)
0809 02:21:56.242545 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:56.242608 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":65,"threads_started":1}
I20260809 02:21:57.031594 27908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:57.031368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.129:60957)
0809 02:21:57.031513 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:57.031545 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":77,"threads_started":1}
I20260809 02:21:57.111358 27909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:57.111166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.130:50177)
0809 02:21:57.111284 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:57.111320 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":60,"threads_started":1}
I20260809 02:21:57.243302 27910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:57.243101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.131:54181)
0809 02:21:57.243227 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:57.243263 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":58,"threads_started":1}
I20260809 02:21:58.032286 27911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:58.032093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.129:41433)
0809 02:21:58.032206 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:58.032238 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":55,"threads_started":1}
I20260809 02:21:58.074868 27912 raft_consensus.cc:482] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:21:58.074965 27912 raft_consensus.cc:504] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:21:58.075201 27912 leader_election.cc:288] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5000f48bb66e4a52938757a3396e54ec (127.11.93.131:36439), b8f7791c70404b658cb9d853720d6f7b (127.11.93.130:40303)
W20260809 02:21:58.075630 27487 leader_election.cc:341] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b8f7791c70404b658cb9d853720d6f7b (127.11.93.130:40303): Not found: Tablet not found: dba74148fc9d4851b996ebe65003ff76
W20260809 02:21:58.075693 27488 leader_election.cc:341] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5000f48bb66e4a52938757a3396e54ec (127.11.93.131:36439): Not found: Tablet not found: dba74148fc9d4851b996ebe65003ff76
I20260809 02:21:58.075722 27487 leader_election.cc:302] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 523aaf1686164a4e821badd45f8acd8a; no voters: 5000f48bb66e4a52938757a3396e54ec, b8f7791c70404b658cb9d853720d6f7b
I20260809 02:21:58.075794 27912 raft_consensus.cc:2726] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:21:58.112010 27913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:58.111801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.130:33945)
0809 02:21:58.111934 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:58.111971 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":63,"threads_started":1}
I20260809 02:21:58.243939 27914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:58.243722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.131:44135)
0809 02:21:58.243853 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:58.243896 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":62,"threads_started":1}
I20260809 02:21:59.033143 27915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:59.032801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.129:40363)
0809 02:21:59.033030 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:59.033080 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":88,"threads_started":1}
I20260809 02:21:59.112722 27916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:59.112518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.130:46665)
0809 02:21:59.112641 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:59.112681 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":62,"threads_started":1}
I20260809 02:21:59.244691 27917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:21:59.244473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.131:37729)
0809 02:21:59.244610 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 02:21:59.244650 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":83,"threads_started":1}
I20260809 02:22:00.033946 27918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:00.033681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.129:42479)
0809 02:22:00.033835 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:00.033876 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":86,"threads_started":1}
I20260809 02:22:00.113469 27919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:00.113193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.130:49283)
0809 02:22:00.113352 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:00.113423 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":74,"threads_started":1}
I20260809 02:22:00.245381 27921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:00.245156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.131:53861)
0809 02:22:00.245298 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:00.245337 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":81,"threads_started":1}
I20260809 02:22:00.856148 27922 raft_consensus.cc:482] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:22:00.856277 27922 raft_consensus.cc:504] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:22:00.856513 27922 leader_election.cc:288] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5000f48bb66e4a52938757a3396e54ec (127.11.93.131:36439), b8f7791c70404b658cb9d853720d6f7b (127.11.93.130:40303)
W20260809 02:22:00.856978 27487 leader_election.cc:341] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b8f7791c70404b658cb9d853720d6f7b (127.11.93.130:40303): Not found: Tablet not found: dba74148fc9d4851b996ebe65003ff76
W20260809 02:22:00.857216 27488 leader_election.cc:341] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5000f48bb66e4a52938757a3396e54ec (127.11.93.131:36439): Not found: Tablet not found: dba74148fc9d4851b996ebe65003ff76
I20260809 02:22:00.857288 27488 leader_election.cc:302] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 523aaf1686164a4e821badd45f8acd8a; no voters: 5000f48bb66e4a52938757a3396e54ec, b8f7791c70404b658cb9d853720d6f7b
I20260809 02:22:00.857415 27922 raft_consensus.cc:2726] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:22:01.034718 27923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:01.034462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.129:38857)
0809 02:22:01.034586 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:01.034617 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":65,"threads_started":1}
I20260809 02:22:01.114319 27924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:01.114040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.130:54111)
0809 02:22:01.114224 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:01.114271 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":81,"threads_started":1}
I20260809 02:22:01.246089 27925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:01.245843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.131:43013)
0809 02:22:01.245989 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:01.246030 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":58,"threads_started":1}
I20260809 02:22:02.035440 27926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:02.035200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.129:43677)
0809 02:22:02.035343 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:02.035381 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":81,"threads_started":1}
I20260809 02:22:02.115092 27927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:02.114808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.130:39091)
0809 02:22:02.114945 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:02.115046 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":59,"threads_started":1}
I20260809 02:22:02.246778 27928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:02.246557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.131:50599)
0809 02:22:02.246699 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:02.246735 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":79,"threads_started":1}
I20260809 02:22:03.036203 27929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:03.035990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.129:42251)
0809 02:22:03.036109 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:03.036144 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":68,"threads_started":1}
I20260809 02:22:03.115830 27930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:03.115605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.130:59755)
0809 02:22:03.115743 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:03.115785 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":78,"threads_started":1}
I20260809 02:22:03.247488 27931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:03.247235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.131:34297)
0809 02:22:03.247384 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:03.247426 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":82,"threads_started":1}
I20260809 02:22:03.254480 27932 raft_consensus.cc:482] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:22:03.254587 27932 raft_consensus.cc:504] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:22:03.254792 27932 leader_election.cc:288] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5000f48bb66e4a52938757a3396e54ec (127.11.93.131:36439), b8f7791c70404b658cb9d853720d6f7b (127.11.93.130:40303)
W20260809 02:22:03.255226 27488 leader_election.cc:341] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5000f48bb66e4a52938757a3396e54ec (127.11.93.131:36439): Not found: Tablet not found: dba74148fc9d4851b996ebe65003ff76
W20260809 02:22:03.255317 27487 leader_election.cc:341] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b8f7791c70404b658cb9d853720d6f7b (127.11.93.130:40303): Not found: Tablet not found: dba74148fc9d4851b996ebe65003ff76
I20260809 02:22:03.255409 27487 leader_election.cc:302] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 523aaf1686164a4e821badd45f8acd8a; no voters: 5000f48bb66e4a52938757a3396e54ec, b8f7791c70404b658cb9d853720d6f7b
I20260809 02:22:03.255505 27932 raft_consensus.cc:2726] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:22:04.036875 27933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:04.036647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.129:36377)
0809 02:22:04.036782 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:04.036825 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":64,"threads_started":1}
I20260809 02:22:04.116583 27934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:04.116353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.130:60339)
0809 02:22:04.116490 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:04.116537 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":68,"threads_started":1}
I20260809 02:22:04.248217 27936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:04.247943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.131:53639)
0809 02:22:04.248086 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:04.248130 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":58,"threads_started":1}
I20260809 02:22:05.037599 27937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:05.037351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.129:57127)
0809 02:22:05.037509 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:05.037550 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":84,"threads_started":1}
I20260809 02:22:05.117305 27938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:05.117099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.130:58341)
0809 02:22:05.117220 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:05.117258 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":63,"threads_started":1}
I20260809 02:22:05.135490 27939 raft_consensus.cc:482] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:22:05.135588 27939 raft_consensus.cc:504] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5000f48bb66e4a52938757a3396e54ec" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 36439 } } peers { permanent_uuid: "b8f7791c70404b658cb9d853720d6f7b" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40303 } } peers { permanent_uuid: "523aaf1686164a4e821badd45f8acd8a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 34185 } }
I20260809 02:22:05.135802 27939 leader_election.cc:288] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5000f48bb66e4a52938757a3396e54ec (127.11.93.131:36439), b8f7791c70404b658cb9d853720d6f7b (127.11.93.130:40303)
W20260809 02:22:05.136289 27487 leader_election.cc:341] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b8f7791c70404b658cb9d853720d6f7b (127.11.93.130:40303): Not found: Tablet not found: dba74148fc9d4851b996ebe65003ff76
W20260809 02:22:05.136372 27488 leader_election.cc:341] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5000f48bb66e4a52938757a3396e54ec (127.11.93.131:36439): Not found: Tablet not found: dba74148fc9d4851b996ebe65003ff76
I20260809 02:22:05.136502 27488 leader_election.cc:302] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 523aaf1686164a4e821badd45f8acd8a; no voters: 5000f48bb66e4a52938757a3396e54ec, b8f7791c70404b658cb9d853720d6f7b
I20260809 02:22:05.136615 27939 raft_consensus.cc:2726] T dba74148fc9d4851b996ebe65003ff76 P 523aaf1686164a4e821badd45f8acd8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:22:05.248953 27940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:05.248754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.131:59723)
0809 02:22:05.248871 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:05.248911 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":61,"threads_started":1}
I20260809 02:22:06.038395 27941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:06.038154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.129:41555)
0809 02:22:06.038303 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:06.038344 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":114,"threads_started":1}
I20260809 02:22:06.118013 27942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:06.117805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.130:46195)
0809 02:22:06.117930 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:06.117966 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":63,"threads_started":1}
I20260809 02:22:06.249636 27943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:06.249416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.131:53593)
0809 02:22:06.249556 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:06.249591 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":82,"threads_started":1}
I20260809 02:22:07.039225 27944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:07.038897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.129:52873)
0809 02:22:07.039110 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:07.039160 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":64,"threads_started":1}
I20260809 02:22:07.118930 27945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:07.118663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.130:41001)
0809 02:22:07.118835 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:07.118881 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":79,"threads_started":1}
I20260809 02:22:07.250389 27946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:07.250138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.131:52933)
0809 02:22:07.250299 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:07.250342 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":84,"threads_started":1}
I20260809 02:22:08.039938 27947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:08.039668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.129:37451)
0809 02:22:08.039811 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:08.039849 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":85,"threads_started":1}
I20260809 02:22:08.120133 27948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:08.119727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.130:51731)
0809 02:22:08.119996 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:08.120067 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":109,"threads_started":1}
I20260809 02:22:08.251638 27949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:08.251192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.131:50419)
0809 02:22:08.251438 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:08.251521 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":113,"threads_started":1}
I20260809 02:22:09.040728 27950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:09.040406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.129:50805)
0809 02:22:09.040609 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:09.040662 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":103,"threads_started":1}
I20260809 02:22:09.121340 27951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:09.120955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.130:55063)
0809 02:22:09.121159 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:09.121233 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":103,"threads_started":1}
I20260809 02:22:09.252720 27952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:09.252405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.131:39337)
0809 02:22:09.252587 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:09.252656 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":90,"threads_started":1}
I20260809 02:22:10.041599 27953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:10.041381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.129:42311)
0809 02:22:10.041507 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:10.041551 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":61,"threads_started":1}
I20260809 02:22:10.122363 27955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:10.122042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.130:40803)
0809 02:22:10.122271 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:10.122315 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":97,"threads_started":1}
I20260809 02:22:10.253523 27956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:10.253306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:42131 (local address 127.11.93.131:57973)
0809 02:22:10.253447 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:10.253480 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:42131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":68,"threads_started":1}
I20260809 02:22:10.253645 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 27438
I20260809 02:22:10.260001 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 27619
I20260809 02:22:10.265713 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 27761
2026-08-09T02:22:10Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18371 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:22:10 dist-test-slave-w206 krb5kdc[27959](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:22:10 dist-test-slave-w206 krb5kdc[27959](info): set up 2 sockets
Aug 09 02:22:10 dist-test-slave-w206 krb5kdc[27959](info): commencing operation
krb5kdc: starting...
W20260809 02:22:11.345996 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:22:11 dist-test-slave-w206 krb5kdc[27959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:22:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:22:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:22:11.473317 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:40059
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:40059
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:22:11.557762 27972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:22:11.558010 27972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:22:11.558048 27972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:22:11.559232 27972 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 02:22:11.559298 27972 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 02:22:11.559319 27972 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 02:22:11.559338 27972 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:22:11.559366 27972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:22:11.559399 27972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:22:11.559424 27972 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:22:11.559453 27972 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:22:11.560956 27972 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:40059
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:40059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27972
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:22:11.561244 27972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:22:11.561479 27972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:22:11.567031 27980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:11.567101 27978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:11.567101 27977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:11.567164 27972 server_base.cc:1034] running on GCE node
I20260809 02:22:11.567493 27972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:22:11.567898 27972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:22:11.569085 27972 hybrid_clock.cc:648] HybridClock initialized: now 1786242131569067 us; error 29 us; skew 500 ppm
Aug 09 02:22:11 dist-test-slave-w206 krb5kdc[27959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242131, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:22:11.571899 27972 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:22:11.572460 27972 webserver.cc:460] Webserver started at http://127.11.93.190:43267/ using document root <none> and password file <none>
I20260809 02:22:11.572726 27972 fs_manager.cc:359] Metadata directory not provided
I20260809 02:22:11.572806 27972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:22:11.572976 27972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:22:11.574158 27972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "daf7713fd6aa47cea16b66d3f8bc7a83"
format_stamp: "Formatted at 2026-08-09 02:22:11 on dist-test-slave-w206"
server_key: "04e2deba78f51b0a4c6127e7706bb39b"
server_key_iv: "0758fc4262393071be52afa6b5cc212f"
server_key_version: "encryptionkey@0"
I20260809 02:22:11.574571 27972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "daf7713fd6aa47cea16b66d3f8bc7a83"
format_stamp: "Formatted at 2026-08-09 02:22:11 on dist-test-slave-w206"
server_key: "04e2deba78f51b0a4c6127e7706bb39b"
server_key_iv: "0758fc4262393071be52afa6b5cc212f"
server_key_version: "encryptionkey@0"
I20260809 02:22:11.576179 27972 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:22:11.577179 27988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:11.577416 27972 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:22:11.577530 27972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "daf7713fd6aa47cea16b66d3f8bc7a83"
format_stamp: "Formatted at 2026-08-09 02:22:11 on dist-test-slave-w206"
server_key: "04e2deba78f51b0a4c6127e7706bb39b"
server_key_iv: "0758fc4262393071be52afa6b5cc212f"
server_key_version: "encryptionkey@0"
I20260809 02:22:11.577608 27972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:22:11.592473 27972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:22:11.594419 27972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:22:11.594590 27972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:22:11.598935 27972 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:40059
I20260809 02:22:11.599056 28043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:40059 every 8 connection(s)
I20260809 02:22:11.599395 27972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:22:11.600390 28044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:22:11.602779 28044 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83: Bootstrap starting.
I20260809 02:22:11.603487 28044 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83: Neither blocks nor log segments found. Creating new log.
I20260809 02:22:11.603802 28044 log.cc:824] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83: Log is configured to *not* fsync() on all Append() calls
I20260809 02:22:11.604583 28044 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83: No bootstrap required, opened a new log
I20260809 02:22:11.606177 28044 raft_consensus.cc:348] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40059 } }
I20260809 02:22:11.606316 28044 raft_consensus.cc:374] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:22:11.606340 28044 raft_consensus.cc:729] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daf7713fd6aa47cea16b66d3f8bc7a83, State: Initialized, Role: FOLLOWER
I20260809 02:22:11.606498 28044 consensus_queue.cc:260] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40059 } }
I20260809 02:22:11.606575 28044 raft_consensus.cc:388] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:22:11.606597 28044 raft_consensus.cc:482] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:22:11.606647 28044 raft_consensus.cc:3037] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:22:11.607254 28044 raft_consensus.cc:504] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40059 } }
I20260809 02:22:11.607345 28044 leader_election.cc:302] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: daf7713fd6aa47cea16b66d3f8bc7a83; no voters:
I20260809 02:22:11.607575 28044 leader_election.cc:288] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:22:11.607671 28047 raft_consensus.cc:2781] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:22:11.607894 28047 raft_consensus.cc:686] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 1 LEADER]: Becoming Leader. State: Replica: daf7713fd6aa47cea16b66d3f8bc7a83, State: Running, Role: LEADER
I20260809 02:22:11.607895 28044 sys_catalog.cc:564] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:22:11.608014 28047 consensus_queue.cc:237] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40059 } }
I20260809 02:22:11.608467 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 27972
I20260809 02:22:11.608572 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:22:11.608740 28049 sys_catalog.cc:455] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [sys.catalog]: SysCatalogTable state changed. Reason: New leader daf7713fd6aa47cea16b66d3f8bc7a83. Latest consensus state: current_term: 1 leader_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40059 } } }
I20260809 02:22:11.608831 11638 external_mini_cluster.cc:1428] Setting key 2ec8f49052df3120664b0dcd5a4199b1
I20260809 02:22:11.608837 28049 sys_catalog.cc:458] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [sys.catalog]: This master's current role is: LEADER
I20260809 02:22:11.608736 28048 sys_catalog.cc:455] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40059 } } }
I20260809 02:22:11.609125 28048 sys_catalog.cc:458] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [sys.catalog]: This master's current role is: LEADER
I20260809 02:22:11.609375 28058 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:22:11.609956 28058 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:22:11.612449 28058 catalog_manager.cc:1347] Generated new cluster ID: 7de03ceed9dc413b92343465c7295e3d
I20260809 02:22:11.612506 28058 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 02:22:11 dist-test-slave-w206 krb5kdc[27959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:22:11.618110 28058 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:22:11.618796 28058 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:22:11.620853 28065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:11.609548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51994 (local address 127.11.93.190:40059)
0809 02:22:11.609822 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:11.609853 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:11.609892 (+ 39us) server_negotiation.cc:407] Connection header received
0809 02:22:11.610051 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:11.610058 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:11.610116 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:11.610291 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:22:11.611175 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:11.612304 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:11.613362 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:11.614001 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:11.614124 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:11.617014 (+ 2890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:22:11.617018 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:22:11.617019 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:22:11.617030 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:22:11.619194 (+ 2164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:11.619598 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:11.619601 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:11.619601 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:11.619703 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:11.619927 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:11.619927 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:11.619928 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:11.620198 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:22:11.620337 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:11.620484 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 02:22:11.620626 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":88,"threads_started":1}
I20260809 02:22:11.624990 28058 catalog_manager.cc:5868] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83: Generated new TSK 0
I20260809 02:22:11.625166 28058 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.93.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
I20260809 02:22:11.658911 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:40059
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:22:11.741842 28073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:22:11.742057 28073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:22:11.742081 28073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:22:11.743290 28073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:22:11.743336 28073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:22:11.743402 28073 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:22:11.744940 28073 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:40059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:22:11.745203 28073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:22:11.745434 28073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:22:11.750638 28081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:11.750645 28078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:11.750698 28073 server_base.cc:1034] running on GCE node
W20260809 02:22:11.750638 28079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:11.751137 28073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:22:11.751338 28073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:22:11.752478 28073 hybrid_clock.cc:648] HybridClock initialized: now 1786242131752469 us; error 27 us; skew 500 ppm
Aug 09 02:22:11 dist-test-slave-w206 krb5kdc[27959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242131, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:22:11.765920 28073 init.cc:377] Logged in from keytab as kudu/127.11.93.129@KRBTEST.COM (short username kudu)
I20260809 02:22:11.766338 28073 webserver.cc:460] Webserver started at http://127.11.93.129:42247/ using document root <none> and password file <none>
I20260809 02:22:11.766618 28073 fs_manager.cc:359] Metadata directory not provided
I20260809 02:22:11.766693 28073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:22:11.766849 28073 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:22:11.767988 28073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "dda693cf80f9444ba9e655c1b3fcd95f"
format_stamp: "Formatted at 2026-08-09 02:22:11 on dist-test-slave-w206"
server_key: "efcce32b2eaac80904a749a00754b9bb"
server_key_iv: "382b40cf50fd715da2329176425fbd64"
server_key_version: "encryptionkey@0"
I20260809 02:22:11.768364 28073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "dda693cf80f9444ba9e655c1b3fcd95f"
format_stamp: "Formatted at 2026-08-09 02:22:11 on dist-test-slave-w206"
server_key: "efcce32b2eaac80904a749a00754b9bb"
server_key_iv: "382b40cf50fd715da2329176425fbd64"
server_key_version: "encryptionkey@0"
I20260809 02:22:11.769785 28073 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 02:22:11.770581 28088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:11.770810 28073 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 02:22:11.770936 28073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "dda693cf80f9444ba9e655c1b3fcd95f"
format_stamp: "Formatted at 2026-08-09 02:22:11 on dist-test-slave-w206"
server_key: "efcce32b2eaac80904a749a00754b9bb"
server_key_iv: "382b40cf50fd715da2329176425fbd64"
server_key_version: "encryptionkey@0"
I20260809 02:22:11.771040 28073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:22:11.791996 28073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:22:11.794545 28073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:22:11.794726 28073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:22:11.795019 28073 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:22:11.795368 28073 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:22:11.795425 28073 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:11.795460 28073 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:22:11.795488 28073 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:11.801347 28073 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:46173
I20260809 02:22:11.801400 28205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:46173 every 8 connection(s)
I20260809 02:22:11.801713 28073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:22:11.804697 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 28073
I20260809 02:22:11.804827 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:22:11.805027 11638 external_mini_cluster.cc:1428] Setting key c5e6c9010480e2232e8d638a2d7e9391
Aug 09 02:22:11 dist-test-slave-w206 krb5kdc[27959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242131, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:22:11.812129 28065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:11.802448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:56809 (local address 127.11.93.190:40059)
0809 02:22:11.802525 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:11.802527 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:11.802763 (+ 236us) server_negotiation.cc:407] Connection header received
0809 02:22:11.803346 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:11.803347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:11.803357 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:11.803413 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:22:11.804340 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:11.804976 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:11.806175 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:11.806393 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:11.806470 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:11.809141 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:22:11.809143 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:22:11.809143 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:22:11.809150 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:22:11.810632 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:11.811106 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:11.811107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:11.811107 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:11.811170 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:11.811451 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:11.811452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:11.811452 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:11.811576 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:22:11.811649 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:11.811949 (+ 300us) server_negotiation.cc:299] Negotiation successful
0809 02:22:11.812039 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:22:11.812318 28208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:11.802444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.129:56809)
0809 02:22:11.802637 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:11.802673 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:11.803252 (+ 579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:11.803481 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:11.803485 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:11.804060 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:22:11.804250 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:11.804254 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:11.805081 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:11.805082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:11.806086 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:11.806089 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:11.806478 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:11.806479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:11.806620 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:11.807172 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:22:11.807181 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:22:11.809022 (+ 1841us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:22:11.810739 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:22:11.810747 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:22:11.810750 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:22:11.811044 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:22:11.811240 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:22:11.811241 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:22:11.811242 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:22:11.811370 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:22:11.811652 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:22:11.811661 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:22:11.811799 (+ 138us) client_negotiation.cc:769] Sending connection context
0809 02:22:11.811909 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 02:22:11.812065 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":94,"threads_started":1}
I20260809 02:22:11.812793 28206 heartbeater.cc:347] Connected to a master server at 127.11.93.190:40059
I20260809 02:22:11.812911 28206 heartbeater.cc:464] Registering TS with master...
I20260809 02:22:11.813088 28206 heartbeater.cc:511] Master 127.11.93.190:40059 requested a full tablet report, sending...
I20260809 02:22:11.813609 28008 ts_manager.cc:194] Registered new tserver with Master: dda693cf80f9444ba9e655c1b3fcd95f (127.11.93.129:46173)
WARNING: no policy specified for kudu/127.11.93.130@KRBTEST.COM; defaulting to no policy
I20260809 02:22:11.814235 28008 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:56809
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
I20260809 02:22:11.835602 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:40059
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:22:11.928574 28211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:22:11.928793 28211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:22:11.928817 28211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:22:11.929905 28211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:22:11.929939 28211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:22:11.929965 28211 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:22:11.931397 28211 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:40059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28211
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:22:11.931588 28211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:22:11.931771 28211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:22:11.936977 28219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:11.937139 28211 server_base.cc:1034] running on GCE node
W20260809 02:22:11.936980 28217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:11.937047 28216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:11.937510 28211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:22:11.937737 28211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:22:11.938894 28211 hybrid_clock.cc:648] HybridClock initialized: now 1786242131938851 us; error 57 us; skew 500 ppm
Aug 09 02:22:11 dist-test-slave-w206 krb5kdc[27959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242131, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:22:11.941866 28211 init.cc:377] Logged in from keytab as kudu/127.11.93.130@KRBTEST.COM (short username kudu)
I20260809 02:22:11.942380 28211 webserver.cc:460] Webserver started at http://127.11.93.130:37943/ using document root <none> and password file <none>
I20260809 02:22:11.942615 28211 fs_manager.cc:359] Metadata directory not provided
I20260809 02:22:11.942682 28211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:22:11.942848 28211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:22:11.944010 28211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "ec3ac562aaa6489d95e48d18a67fa409"
format_stamp: "Formatted at 2026-08-09 02:22:11 on dist-test-slave-w206"
server_key: "375aa72736b451d7adcab5b859c326ef"
server_key_iv: "962e5944c4528c4d2232251d495870cf"
server_key_version: "encryptionkey@0"
I20260809 02:22:11.944391 28211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "ec3ac562aaa6489d95e48d18a67fa409"
format_stamp: "Formatted at 2026-08-09 02:22:11 on dist-test-slave-w206"
server_key: "375aa72736b451d7adcab5b859c326ef"
server_key_iv: "962e5944c4528c4d2232251d495870cf"
server_key_version: "encryptionkey@0"
I20260809 02:22:11.945787 28211 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:22:11.946522 28226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:11.946708 28211 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:11.946810 28211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "ec3ac562aaa6489d95e48d18a67fa409"
format_stamp: "Formatted at 2026-08-09 02:22:11 on dist-test-slave-w206"
server_key: "375aa72736b451d7adcab5b859c326ef"
server_key_iv: "962e5944c4528c4d2232251d495870cf"
server_key_version: "encryptionkey@0"
I20260809 02:22:11.946893 28211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:22:11.958137 28211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:22:11.960115 28211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:22:11.960280 28211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:22:11.960520 28211 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:22:11.960858 28211 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:22:11.960913 28211 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:11.960953 28211 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:22:11.960978 28211 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:11.967175 28211 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:36587
I20260809 02:22:11.967234 28350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:36587 every 8 connection(s)
I20260809 02:22:11.967561 28211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:22:11.971710 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 28211
I20260809 02:22:11.971834 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:22:11.972074 11638 external_mini_cluster.cc:1428] Setting key 1d708d0d1c9e7bfd87e09f9273e90cc5
Aug 09 02:22:11 dist-test-slave-w206 krb5kdc[27959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242131, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:22:11.977855 28065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:11.968355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:37345 (local address 127.11.93.190:40059)
0809 02:22:11.968425 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:11.968427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:11.968640 (+ 213us) server_negotiation.cc:407] Connection header received
0809 02:22:11.969122 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:11.969123 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:11.969134 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:11.969196 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:22:11.970123 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:11.970623 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:11.971734 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:11.972069 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:11.972147 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:11.974895 (+ 2748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:22:11.974898 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:22:11.974898 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:22:11.974908 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:22:11.976369 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:11.976867 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:11.976868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:11.976868 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:11.976921 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:11.977221 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:11.977221 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:11.977222 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:11.977327 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:22:11.977380 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:11.977727 (+ 347us) server_negotiation.cc:299] Negotiation successful
0809 02:22:11.977790 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 02:22:11.978142 28353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:11.968335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.130:37345)
0809 02:22:11.968503 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:11.968547 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:11.969032 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:11.969250 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:11.969254 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:11.969841 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:22:11.970038 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:11.970043 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:11.970732 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:11.970733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:11.971643 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:11.971646 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:11.972203 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:11.972205 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:11.972334 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:11.973013 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:22:11.973022 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:22:11.974723 (+ 1701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:22:11.976453 (+ 1730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:22:11.976460 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:22:11.976462 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:22:11.976788 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:22:11.976987 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:22:11.976988 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:22:11.976988 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:22:11.977145 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:22:11.977400 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:22:11.977407 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:22:11.977579 (+ 172us) client_negotiation.cc:769] Sending connection context
0809 02:22:11.977706 (+ 127us) client_negotiation.cc:240] Negotiation successful
0809 02:22:11.977886 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":96,"threads_started":1}
I20260809 02:22:11.978673 28351 heartbeater.cc:347] Connected to a master server at 127.11.93.190:40059
I20260809 02:22:11.978786 28351 heartbeater.cc:464] Registering TS with master...
I20260809 02:22:11.979024 28351 heartbeater.cc:511] Master 127.11.93.190:40059 requested a full tablet report, sending...
I20260809 02:22:11.979461 28008 ts_manager.cc:194] Registered new tserver with Master: ec3ac562aaa6489d95e48d18a67fa409 (127.11.93.130:36587)
I20260809 02:22:11.980027 28008 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:37345
WARNING: no policy specified for kudu/127.11.93.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
I20260809 02:22:11.999956 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:40059
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:22:12.084288 28356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:22:12.084501 28356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:22:12.084523 28356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:22:12.085599 28356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:22:12.085635 28356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:22:12.085661 28356 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:22:12.087150 28356 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:40059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28356
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:22:12.087339 28356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:22:12.087561 28356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:22:12.092695 28362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:12.092799 28356 server_base.cc:1034] running on GCE node
W20260809 02:22:12.092724 28361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:12.092744 28364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:12.093122 28356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:22:12.093374 28356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:22:12.094554 28356 hybrid_clock.cc:648] HybridClock initialized: now 1786242132094527 us; error 40 us; skew 500 ppm
Aug 09 02:22:12 dist-test-slave-w206 krb5kdc[27959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242132, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:22:12.097364 28356 init.cc:377] Logged in from keytab as kudu/127.11.93.131@KRBTEST.COM (short username kudu)
I20260809 02:22:12.097786 28356 webserver.cc:460] Webserver started at http://127.11.93.131:35193/ using document root <none> and password file <none>
I20260809 02:22:12.098057 28356 fs_manager.cc:359] Metadata directory not provided
I20260809 02:22:12.098107 28356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:22:12.098289 28356 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:22:12.099483 28356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "45740c812bfb44fb8e8694792410fe99"
format_stamp: "Formatted at 2026-08-09 02:22:12 on dist-test-slave-w206"
server_key: "1d7a75073c46c8b235296bfbbf3917a9"
server_key_iv: "00e301e902329faaa2bf852d9f70ae49"
server_key_version: "encryptionkey@0"
I20260809 02:22:12.099869 28356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "45740c812bfb44fb8e8694792410fe99"
format_stamp: "Formatted at 2026-08-09 02:22:12 on dist-test-slave-w206"
server_key: "1d7a75073c46c8b235296bfbbf3917a9"
server_key_iv: "00e301e902329faaa2bf852d9f70ae49"
server_key_version: "encryptionkey@0"
I20260809 02:22:12.101269 28356 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260809 02:22:12.102047 28371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:12.102324 28356 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:22:12.102406 28356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "45740c812bfb44fb8e8694792410fe99"
format_stamp: "Formatted at 2026-08-09 02:22:12 on dist-test-slave-w206"
server_key: "1d7a75073c46c8b235296bfbbf3917a9"
server_key_iv: "00e301e902329faaa2bf852d9f70ae49"
server_key_version: "encryptionkey@0"
I20260809 02:22:12.102504 28356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:22:12.122326 28356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:22:12.124500 28356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:22:12.124693 28356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:22:12.125013 28356 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:22:12.125437 28356 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:22:12.125494 28356 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:12.125535 28356 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:22:12.125569 28356 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:12.132162 28356 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:37815
I20260809 02:22:12.132203 28493 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:37815 every 8 connection(s)
I20260809 02:22:12.132593 28356 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:22:12.135813 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 28356
I20260809 02:22:12.135919 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:22:12.136108 11638 external_mini_cluster.cc:1428] Setting key 37505f2d166ce2981f0341d195133d83
Aug 09 02:22:12 dist-test-slave-w206 krb5kdc[27959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242132, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:22:12.142385 28065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:12.133433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:58605 (local address 127.11.93.190:40059)
0809 02:22:12.133483 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:12.133485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:12.133661 (+ 176us) server_negotiation.cc:407] Connection header received
0809 02:22:12.134162 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:12.134163 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:12.134174 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:12.134251 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:22:12.135201 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.135814 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.137211 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.137400 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.137456 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:12.139725 (+ 2269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:22:12.139727 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:22:12.139727 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:22:12.139734 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:22:12.141144 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:12.141526 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:12.141527 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:12.141528 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:12.141587 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:12.141804 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:12.141805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:12.141805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:12.141918 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:22:12.141973 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:12.142240 (+ 267us) server_negotiation.cc:299] Negotiation successful
0809 02:22:12.142320 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 02:22:12.142504 28496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:12.133362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.131:58605)
0809 02:22:12.133532 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:12.133575 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:12.134049 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:12.134322 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:12.134326 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:12.134898 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:22:12.135108 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:12.135113 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.135958 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.135959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:12.137136 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:12.137144 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.137474 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.137475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:12.137575 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:12.138125 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:22:12.138134 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:22:12.139612 (+ 1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:22:12.141226 (+ 1614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:22:12.141233 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:22:12.141234 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:22:12.141453 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:22:12.141650 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:22:12.141650 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:22:12.141651 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:22:12.141745 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:22:12.141976 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:22:12.141980 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:22:12.142090 (+ 110us) client_negotiation.cc:769] Sending connection context
0809 02:22:12.142172 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 02:22:12.142288 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":97,"threads_started":1}
I20260809 02:22:12.143079 28494 heartbeater.cc:347] Connected to a master server at 127.11.93.190:40059
I20260809 02:22:12.143165 28494 heartbeater.cc:464] Registering TS with master...
I20260809 02:22:12.143303 28494 heartbeater.cc:511] Master 127.11.93.190:40059 requested a full tablet report, sending...
I20260809 02:22:12.143666 28008 ts_manager.cc:194] Registered new tserver with Master: 45740c812bfb44fb8e8694792410fe99 (127.11.93.131:37815)
I20260809 02:22:12.144001 28008 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:58605
I20260809 02:22:12.148020 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:22:12.156136 28065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:12.149542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52008 (local address 127.11.93.190:40059)
0809 02:22:12.149618 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:12.149620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:12.149745 (+ 125us) server_negotiation.cc:407] Connection header received
0809 02:22:12.149783 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:12.149784 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:12.149793 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:12.149893 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:22:12.150530 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.151120 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.151890 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.152083 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.152198 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:12.153419 (+ 1221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:22:12.153421 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:22:12.153421 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:22:12.153428 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:22:12.154633 (+ 1205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:12.155128 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:12.155129 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:12.155130 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:12.155187 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:12.155471 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:12.155472 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:12.155472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:12.155635 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:22:12.155752 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:12.155922 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 02:22:12.156008 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:22:12.157702 28008 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52008:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:22:12.160082 28008 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:22:12.166792 28505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:12.162483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:36587 (local address 127.0.0.1:60734)
0809 02:22:12.163058 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:12.163070 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:12.163134 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:12.163434 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:12.163437 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:12.163440 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:22:12.163526 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:12.163529 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.164459 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.164459 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:12.165605 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:12.165608 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.166509 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.166510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:12.166564 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:12.166574 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 02:22:12.166653 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 02:22:12.166711 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"mutex_wait_us":2,"thread_start_us":104,"threads_started":1}
I20260809 02:22:12.166810 28509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:12.162687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60734 (local address 127.11.93.130:36587)
0809 02:22:12.162900 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:12.162905 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:12.163131 (+ 226us) server_negotiation.cc:407] Connection header received
0809 02:22:12.163220 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:12.163223 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:12.163240 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:12.163324 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:22:12.163624 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.164363 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.165709 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.166383 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.166419 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:12.166461 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:12.166681 (+ 220us) server_negotiation.cc:299] Negotiation successful
0809 02:22:12.166720 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":107,"threads_started":1}
I20260809 02:22:12.167214 28508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:12.162480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:37815 (local address 127.0.0.1:39570)
0809 02:22:12.162913 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:12.162924 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:12.162963 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:12.163442 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:12.163443 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:12.163446 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:22:12.163529 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:12.163531 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.164899 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.164900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:12.165839 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:12.165842 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.166897 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.166898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:12.167015 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:12.167020 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:22:12.167085 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 02:22:12.167132 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"mutex_wait_us":32,"thread_start_us":71,"threads_started":1}
I20260809 02:22:12.167227 28510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:12.162718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39570 (local address 127.11.93.131:37815)
0809 02:22:12.162946 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:12.162949 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:12.162961 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:22:12.163095 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:12.163097 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:12.163116 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:12.163216 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:22:12.163627 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.164769 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.165946 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.166682 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.166756 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:12.166808 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:12.167105 (+ 297us) server_negotiation.cc:299] Negotiation successful
0809 02:22:12.167150 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":122,"threads_started":1}
I20260809 02:22:12.167742 28279 tablet_service.cc:1467] Processing CreateTablet for tablet 90525bbf2be04bc9ae3dc810ad69e453 (DEFAULT_TABLE table=test-table [id=45ee4ba31cb945cbb9fe384f484431ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:22:12.167961 28422 tablet_service.cc:1467] Processing CreateTablet for tablet 90525bbf2be04bc9ae3dc810ad69e453 (DEFAULT_TABLE table=test-table [id=45ee4ba31cb945cbb9fe384f484431ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:22:12.168145 28279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90525bbf2be04bc9ae3dc810ad69e453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:22:12.168267 28422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90525bbf2be04bc9ae3dc810ad69e453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:22:12.171715 28512 tablet_bootstrap.cc:492] T 90525bbf2be04bc9ae3dc810ad69e453 P ec3ac562aaa6489d95e48d18a67fa409: Bootstrap starting.
I20260809 02:22:12.172118 28507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:12.162480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:46173 (local address 127.0.0.1:36760)
0809 02:22:12.162674 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:12.162720 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:12.162799 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:12.163606 (+ 807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:12.163607 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:12.163609 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:22:12.163643 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:12.163644 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.164895 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.164896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:12.166047 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:12.166049 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.171883 (+ 5834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.171885 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:12.171971 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:12.171976 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:22:12.172025 (+ 49us) client_negotiation.cc:240] Negotiation successful
0809 02:22:12.172063 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":28,"thread_start_us":97,"threads_started":1}
I20260809 02:22:12.172231 28511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:12.162938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36760 (local address 127.11.93.129:46173)
0809 02:22:12.163382 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:12.163386 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:12.163396 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:22:12.163435 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:12.163437 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:12.163451 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:12.163526 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:22:12.163710 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.164785 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.166136 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.166842 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.171754 (+ 4912us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:12.171845 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:12.172077 (+ 232us) server_negotiation.cc:299] Negotiation successful
0809 02:22:12.172144 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":117,"threads_started":1}
I20260809 02:22:12.172525 28512 tablet_bootstrap.cc:654] T 90525bbf2be04bc9ae3dc810ad69e453 P ec3ac562aaa6489d95e48d18a67fa409: Neither blocks nor log segments found. Creating new log.
I20260809 02:22:12.172869 28137 tablet_service.cc:1467] Processing CreateTablet for tablet 90525bbf2be04bc9ae3dc810ad69e453 (DEFAULT_TABLE table=test-table [id=45ee4ba31cb945cbb9fe384f484431ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:22:12.173074 28512 log.cc:824] T 90525bbf2be04bc9ae3dc810ad69e453 P ec3ac562aaa6489d95e48d18a67fa409: Log is configured to *not* fsync() on all Append() calls
I20260809 02:22:12.173228 28137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90525bbf2be04bc9ae3dc810ad69e453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:22:12.173506 28513 tablet_bootstrap.cc:492] T 90525bbf2be04bc9ae3dc810ad69e453 P 45740c812bfb44fb8e8694792410fe99: Bootstrap starting.
I20260809 02:22:12.173990 28512 tablet_bootstrap.cc:492] T 90525bbf2be04bc9ae3dc810ad69e453 P ec3ac562aaa6489d95e48d18a67fa409: No bootstrap required, opened a new log
I20260809 02:22:12.174059 28512 ts_tablet_manager.cc:1397] T 90525bbf2be04bc9ae3dc810ad69e453 P ec3ac562aaa6489d95e48d18a67fa409: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:22:12.174206 28513 tablet_bootstrap.cc:654] T 90525bbf2be04bc9ae3dc810ad69e453 P 45740c812bfb44fb8e8694792410fe99: Neither blocks nor log segments found. Creating new log.
I20260809 02:22:12.174813 28513 log.cc:824] T 90525bbf2be04bc9ae3dc810ad69e453 P 45740c812bfb44fb8e8694792410fe99: Log is configured to *not* fsync() on all Append() calls
I20260809 02:22:12.175529 28513 tablet_bootstrap.cc:492] T 90525bbf2be04bc9ae3dc810ad69e453 P 45740c812bfb44fb8e8694792410fe99: No bootstrap required, opened a new log
I20260809 02:22:12.175614 28513 ts_tablet_manager.cc:1397] T 90525bbf2be04bc9ae3dc810ad69e453 P 45740c812bfb44fb8e8694792410fe99: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260809 02:22:12.176254 28512 raft_consensus.cc:348] T 90525bbf2be04bc9ae3dc810ad69e453 P ec3ac562aaa6489d95e48d18a67fa409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } } peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } }
I20260809 02:22:12.176447 28512 raft_consensus.cc:374] T 90525bbf2be04bc9ae3dc810ad69e453 P ec3ac562aaa6489d95e48d18a67fa409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:22:12.176493 28512 raft_consensus.cc:729] T 90525bbf2be04bc9ae3dc810ad69e453 P ec3ac562aaa6489d95e48d18a67fa409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec3ac562aaa6489d95e48d18a67fa409, State: Initialized, Role: FOLLOWER
I20260809 02:22:12.176669 28512 consensus_queue.cc:260] T 90525bbf2be04bc9ae3dc810ad69e453 P ec3ac562aaa6489d95e48d18a67fa409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } } peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } }
I20260809 02:22:12.176746 28516 tablet_bootstrap.cc:492] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f: Bootstrap starting.
I20260809 02:22:12.176950 28512 ts_tablet_manager.cc:1428] T 90525bbf2be04bc9ae3dc810ad69e453 P ec3ac562aaa6489d95e48d18a67fa409: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 02:22:12.177119 28351 heartbeater.cc:503] Master 127.11.93.190:40059 was elected leader, sending a full tablet report...
I20260809 02:22:12.177408 28516 tablet_bootstrap.cc:654] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f: Neither blocks nor log segments found. Creating new log.
I20260809 02:22:12.177316 28513 raft_consensus.cc:348] T 90525bbf2be04bc9ae3dc810ad69e453 P 45740c812bfb44fb8e8694792410fe99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } } peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } }
I20260809 02:22:12.177474 28513 raft_consensus.cc:374] T 90525bbf2be04bc9ae3dc810ad69e453 P 45740c812bfb44fb8e8694792410fe99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:22:12.177510 28513 raft_consensus.cc:729] T 90525bbf2be04bc9ae3dc810ad69e453 P 45740c812bfb44fb8e8694792410fe99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45740c812bfb44fb8e8694792410fe99, State: Initialized, Role: FOLLOWER
I20260809 02:22:12.177620 28513 consensus_queue.cc:260] T 90525bbf2be04bc9ae3dc810ad69e453 P 45740c812bfb44fb8e8694792410fe99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } } peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } }
I20260809 02:22:12.177886 28513 ts_tablet_manager.cc:1428] T 90525bbf2be04bc9ae3dc810ad69e453 P 45740c812bfb44fb8e8694792410fe99: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260809 02:22:12.177943 28494 heartbeater.cc:503] Master 127.11.93.190:40059 was elected leader, sending a full tablet report...
I20260809 02:22:12.178033 28516 log.cc:824] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f: Log is configured to *not* fsync() on all Append() calls
I20260809 02:22:12.179029 28516 tablet_bootstrap.cc:492] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f: No bootstrap required, opened a new log
I20260809 02:22:12.179102 28516 ts_tablet_manager.cc:1397] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:22:12.180471 28516 raft_consensus.cc:348] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } } peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } }
I20260809 02:22:12.180596 28516 raft_consensus.cc:374] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:22:12.180619 28516 raft_consensus.cc:729] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dda693cf80f9444ba9e655c1b3fcd95f, State: Initialized, Role: FOLLOWER
I20260809 02:22:12.180722 28516 consensus_queue.cc:260] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } } peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } }
I20260809 02:22:12.180975 28516 ts_tablet_manager.cc:1428] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:22:12.181064 28206 heartbeater.cc:503] Master 127.11.93.190:40059 was elected leader, sending a full tablet report...
W20260809 02:22:12.218174 28352 tablet.cc:2369] T 90525bbf2be04bc9ae3dc810ad69e453 P ec3ac562aaa6489d95e48d18a67fa409: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:22:12.302451 28207 tablet.cc:2369] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:22:12.383196 28495 tablet.cc:2369] T 90525bbf2be04bc9ae3dc810ad69e453 P 45740c812bfb44fb8e8694792410fe99: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:22:12.395676 28521 raft_consensus.cc:482] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:22:12.395812 28521 raft_consensus.cc:504] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } } peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } }
I20260809 02:22:12.396253 28521 leader_election.cc:288] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec3ac562aaa6489d95e48d18a67fa409 (127.11.93.130:36587), 45740c812bfb44fb8e8694792410fe99 (127.11.93.131:37815)
I20260809 02:22:12.400616 28510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:12.396580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:35619 (local address 127.11.93.131:37815)
0809 02:22:12.396638 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:12.396640 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:12.396929 (+ 289us) server_negotiation.cc:407] Connection header received
0809 02:22:12.396952 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:12.396953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:12.396960 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:12.397000 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:22:12.397183 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.397919 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.399555 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.400193 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.400281 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:12.400290 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:12.400495 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 02:22:12.400543 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 02:22:12.400616 28509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:12.396682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:36929 (local address 127.11.93.130:36587)
0809 02:22:12.396794 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:12.396795 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:12.396804 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:22:12.396830 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:12.396831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:12.396839 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:12.396893 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:22:12.397099 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.397881 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.399556 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.400202 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.400281 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:12.400290 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:12.400496 (+ 206us) server_negotiation.cc:299] Negotiation successful
0809 02:22:12.400543 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 02:22:12.400641 28523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:12.396462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:37815 (local address 127.11.93.129:35619)
0809 02:22:12.396645 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:12.396657 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:12.396746 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:12.397028 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:12.397029 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:12.397030 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:22:12.397102 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:12.397104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.398001 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.398002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:12.399437 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:12.399438 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.400294 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.400295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:12.400385 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:12.400387 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 02:22:12.400446 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 02:22:12.400513 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":81,"thread_start_us":113,"threads_started":1}
I20260809 02:22:12.400643 28522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:12.396482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:36587 (local address 127.11.93.129:36929)
0809 02:22:12.396657 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:12.396667 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:12.396717 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:12.396929 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:12.396930 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:12.396932 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:22:12.397024 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:12.397027 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.397996 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.397997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:12.399430 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:12.399433 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.400292 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.400293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:12.400380 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:12.400385 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:22:12.400447 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 02:22:12.400513 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":87,"thread_start_us":114,"threads_started":1}
I20260809 02:22:12.401010 28446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90525bbf2be04bc9ae3dc810ad69e453" candidate_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45740c812bfb44fb8e8694792410fe99" is_pre_election: true
I20260809 02:22:12.401175 28446 raft_consensus.cc:2454] T 90525bbf2be04bc9ae3dc810ad69e453 P 45740c812bfb44fb8e8694792410fe99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dda693cf80f9444ba9e655c1b3fcd95f in term 0.
I20260809 02:22:12.401432 28091 leader_election.cc:302] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45740c812bfb44fb8e8694792410fe99, dda693cf80f9444ba9e655c1b3fcd95f; no voters:
I20260809 02:22:12.401444 28300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90525bbf2be04bc9ae3dc810ad69e453" candidate_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec3ac562aaa6489d95e48d18a67fa409" is_pre_election: true
I20260809 02:22:12.401576 28521 raft_consensus.cc:2781] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:22:12.401588 28300 raft_consensus.cc:2454] T 90525bbf2be04bc9ae3dc810ad69e453 P ec3ac562aaa6489d95e48d18a67fa409 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dda693cf80f9444ba9e655c1b3fcd95f in term 0.
I20260809 02:22:12.401639 28521 raft_consensus.cc:482] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:22:12.401670 28521 raft_consensus.cc:3037] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:22:12.402524 28521 raft_consensus.cc:504] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } } peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } }
I20260809 02:22:12.402680 28521 leader_election.cc:288] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 1 election: Requested vote from peers ec3ac562aaa6489d95e48d18a67fa409 (127.11.93.130:36587), 45740c812bfb44fb8e8694792410fe99 (127.11.93.131:37815)
I20260809 02:22:12.402828 28300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90525bbf2be04bc9ae3dc810ad69e453" candidate_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec3ac562aaa6489d95e48d18a67fa409"
I20260809 02:22:12.402872 28446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90525bbf2be04bc9ae3dc810ad69e453" candidate_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45740c812bfb44fb8e8694792410fe99"
I20260809 02:22:12.402918 28300 raft_consensus.cc:3037] T 90525bbf2be04bc9ae3dc810ad69e453 P ec3ac562aaa6489d95e48d18a67fa409 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:22:12.402937 28446 raft_consensus.cc:3037] T 90525bbf2be04bc9ae3dc810ad69e453 P 45740c812bfb44fb8e8694792410fe99 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:22:12.403883 28446 raft_consensus.cc:2454] T 90525bbf2be04bc9ae3dc810ad69e453 P 45740c812bfb44fb8e8694792410fe99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dda693cf80f9444ba9e655c1b3fcd95f in term 1.
I20260809 02:22:12.403883 28300 raft_consensus.cc:2454] T 90525bbf2be04bc9ae3dc810ad69e453 P ec3ac562aaa6489d95e48d18a67fa409 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dda693cf80f9444ba9e655c1b3fcd95f in term 1.
I20260809 02:22:12.404047 28091 leader_election.cc:302] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45740c812bfb44fb8e8694792410fe99, dda693cf80f9444ba9e655c1b3fcd95f; no voters:
I20260809 02:22:12.404176 28521 raft_consensus.cc:2781] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:22:12.404376 28521 raft_consensus.cc:686] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [term 1 LEADER]: Becoming Leader. State: Replica: dda693cf80f9444ba9e655c1b3fcd95f, State: Running, Role: LEADER
I20260809 02:22:12.404484 28521 consensus_queue.cc:237] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } } peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } }
I20260809 02:22:12.405308 28008 catalog_manager.cc:5495] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f reported cstate change: term changed from 0 to 1, leader changed from <none> to dda693cf80f9444ba9e655c1b3fcd95f (127.11.93.129). New cstate: current_term: 1 leader_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } health_report { overall_health: UNKNOWN } } }
I20260809 02:22:12.449151 28511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:12.446693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36766 (local address 127.11.93.129:46173)
0809 02:22:12.446744 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:12.446746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:12.446755 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:22:12.446827 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:12.446827 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:12.446847 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:12.446908 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:22:12.447074 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.447532 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.448296 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:12.448487 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:12.448542 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:12.448665 (+ 123us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:22:12.448822 (+ 157us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:22:12.448886 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:12.448993 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 02:22:12.449013 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 02:22:12.451124 28300 raft_consensus.cc:1261] T 90525bbf2be04bc9ae3dc810ad69e453 P ec3ac562aaa6489d95e48d18a67fa409 [term 1 FOLLOWER]: Refusing update from remote peer dda693cf80f9444ba9e655c1b3fcd95f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:22:12.451129 28446 raft_consensus.cc:1261] T 90525bbf2be04bc9ae3dc810ad69e453 P 45740c812bfb44fb8e8694792410fe99 [term 1 FOLLOWER]: Refusing update from remote peer dda693cf80f9444ba9e655c1b3fcd95f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:22:12.451538 28524 consensus_queue.cc:1035] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [LEADER]: Connected to new peer: Peer: permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:22:12.451699 28521 consensus_queue.cc:1035] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:22:12.455479 28528 mvcc.cc:205] Tried to move back new op lower bound from 7316447774516768768 to 7316447774329364480. Current Snapshot: MvccSnapshot[applied={T|T < 7316447774516768768}]
I20260809 02:22:12.456758 28007 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:22:12.456853 28007 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:22:12.457643 28007 catalog_manager.cc:5782] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83: Sending DeleteTablet for 3 replicas of tablet 90525bbf2be04bc9ae3dc810ad69e453
I20260809 02:22:12.457983 28137 tablet_service.cc:1514] Processing DeleteTablet for tablet 90525bbf2be04bc9ae3dc810ad69e453 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:22:12 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:36760
I20260809 02:22:12.457988 28422 tablet_service.cc:1514] Processing DeleteTablet for tablet 90525bbf2be04bc9ae3dc810ad69e453 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:22:12 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:39570
I20260809 02:22:12.458029 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 28073
I20260809 02:22:12.459811 28536 tablet_replica.cc:330] T 90525bbf2be04bc9ae3dc810ad69e453 P 45740c812bfb44fb8e8694792410fe99: stopping tablet replica
I20260809 02:22:12.459978 28536 raft_consensus.cc:2229] T 90525bbf2be04bc9ae3dc810ad69e453 P 45740c812bfb44fb8e8694792410fe99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:22:12.460158 28536 raft_consensus.cc:2258] T 90525bbf2be04bc9ae3dc810ad69e453 P 45740c812bfb44fb8e8694792410fe99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:22:12.460673 28536 ts_tablet_manager.cc:1905] T 90525bbf2be04bc9ae3dc810ad69e453 P 45740c812bfb44fb8e8694792410fe99: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:22:12.461339 28279 tablet_service.cc:1514] Processing DeleteTablet for tablet 90525bbf2be04bc9ae3dc810ad69e453 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:22:12 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:60734
I20260809 02:22:12.461563 28537 tablet_replica.cc:330] T 90525bbf2be04bc9ae3dc810ad69e453 P ec3ac562aaa6489d95e48d18a67fa409: stopping tablet replica
I20260809 02:22:12.461702 28537 raft_consensus.cc:2229] T 90525bbf2be04bc9ae3dc810ad69e453 P ec3ac562aaa6489d95e48d18a67fa409 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:22:12.461830 28537 raft_consensus.cc:2258] T 90525bbf2be04bc9ae3dc810ad69e453 P ec3ac562aaa6489d95e48d18a67fa409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:22:12.462214 28537 ts_tablet_manager.cc:1905] T 90525bbf2be04bc9ae3dc810ad69e453 P ec3ac562aaa6489d95e48d18a67fa409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:22:12.463011 28536 ts_tablet_manager.cc:1918] T 90525bbf2be04bc9ae3dc810ad69e453 P 45740c812bfb44fb8e8694792410fe99: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:22:12.463091 28536 log.cc:1196] T 90525bbf2be04bc9ae3dc810ad69e453 P 45740c812bfb44fb8e8694792410fe99: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/90525bbf2be04bc9ae3dc810ad69e453
I20260809 02:22:12.463392 28536 ts_tablet_manager.cc:1939] T 90525bbf2be04bc9ae3dc810ad69e453 P 45740c812bfb44fb8e8694792410fe99: Deleting consensus metadata
I20260809 02:22:12.463968 27990 catalog_manager.cc:4841] TS 45740c812bfb44fb8e8694792410fe99 (127.11.93.131:37815): tablet 90525bbf2be04bc9ae3dc810ad69e453 (table test-table [id=45ee4ba31cb945cbb9fe384f484431ee]) successfully deleted
I20260809 02:22:12.464005 28537 ts_tablet_manager.cc:1918] T 90525bbf2be04bc9ae3dc810ad69e453 P ec3ac562aaa6489d95e48d18a67fa409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:22:12.464069 28537 log.cc:1196] T 90525bbf2be04bc9ae3dc810ad69e453 P ec3ac562aaa6489d95e48d18a67fa409: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/90525bbf2be04bc9ae3dc810ad69e453
I20260809 02:22:12.464442 28537 ts_tablet_manager.cc:1939] T 90525bbf2be04bc9ae3dc810ad69e453 P ec3ac562aaa6489d95e48d18a67fa409: Deleting consensus metadata
I20260809 02:22:12.464928 27991 catalog_manager.cc:4841] TS ec3ac562aaa6489d95e48d18a67fa409 (127.11.93.130:36587): tablet 90525bbf2be04bc9ae3dc810ad69e453 (table test-table [id=45ee4ba31cb945cbb9fe384f484431ee]) successfully deleted
W20260809 02:22:12.465975 27989 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.93.129:46173 (error 108)
I20260809 02:22:12.466249 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 28211
I20260809 02:22:12.467621 28507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:12.466401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:46173 (local address 127.0.0.1:36782)
0809 02:22:12.467534 (+ 1133us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:12.467580 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.129:46173: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1107}
W20260809 02:22:12.471144 27989 catalog_manager.cc:4584] TS dda693cf80f9444ba9e655c1b3fcd95f (127.11.93.129:46173): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 90525bbf2be04bc9ae3dc810ad69e453: Network error: Client connection negotiation failed: client connection to 127.11.93.129:46173: connect: Connection refused (error 111)
I20260809 02:22:12.472565 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 28356
I20260809 02:22:12.478641 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 27972
I20260809 02:22:32.485095 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:40059
--webserver_interface=127.11.93.190
--webserver_port=43267
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:40059
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:22:32.572327 28539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:22:32.572548 28539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:22:32.572570 28539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:22:32.573633 28539 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 02:22:32.573668 28539 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 02:22:32.573680 28539 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 02:22:32.573693 28539 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:22:32.573712 28539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:22:32.573725 28539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:22:32.573738 28539 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:22:32.573756 28539 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:22:32.575189 28539 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:40059
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:40059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=43267
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28539
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:22:32.575395 28539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:22:32.575568 28539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:22:32.585608 28546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:32.585611 28545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:32.585660 28539 server_base.cc:1034] running on GCE node
W20260809 02:22:32.585781 28548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:32.586273 28539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:22:32.586618 28539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:22:32.587836 28539 hybrid_clock.cc:648] HybridClock initialized: now 1786242152587809 us; error 40 us; skew 500 ppm
Aug 09 02:22:32 dist-test-slave-w206 krb5kdc[27959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242152, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:22:32.590636 28539 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:22:32.591115 28539 webserver.cc:460] Webserver started at http://127.11.93.190:43267/ using document root <none> and password file <none>
I20260809 02:22:32.591385 28539 fs_manager.cc:359] Metadata directory not provided
I20260809 02:22:32.591470 28539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:22:32.592998 28539 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:22:32.593813 28555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:32.594121 28539 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:22:32.594211 28539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "daf7713fd6aa47cea16b66d3f8bc7a83"
format_stamp: "Formatted at 2026-08-09 02:22:11 on dist-test-slave-w206"
server_key: "04e2deba78f51b0a4c6127e7706bb39b"
server_key_iv: "0758fc4262393071be52afa6b5cc212f"
server_key_version: "encryptionkey@0"
I20260809 02:22:32.594686 28539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:22:32.615784 28539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:22:32.618081 28539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:22:32.618314 28539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:22:32.623157 28539 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:40059
I20260809 02:22:32.623220 28611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:40059 every 8 connection(s)
I20260809 02:22:32.623797 28539 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:22:32.625463 28612 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:22:32.626124 28612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83: Bootstrap starting.
I20260809 02:22:32.632097 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 28539
I20260809 02:22:32.632432 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:46173
--local_ip_for_outbound_sockets=127.11.93.129
--tserver_master_addrs=127.11.93.190:40059
--webserver_port=42247
--webserver_interface=127.11.93.129
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:22:32.635217 28612 log.cc:824] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83: Log is configured to *not* fsync() on all Append() calls
I20260809 02:22:32.637333 28612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:22:32.637696 28612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83: Bootstrap complete.
I20260809 02:22:32.640257 28612 raft_consensus.cc:348] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40059 } }
I20260809 02:22:32.640532 28612 raft_consensus.cc:729] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: daf7713fd6aa47cea16b66d3f8bc7a83, State: Initialized, Role: FOLLOWER
I20260809 02:22:32.640736 28612 consensus_queue.cc:260] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40059 } }
I20260809 02:22:32.640827 28612 raft_consensus.cc:388] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:22:32.640895 28612 raft_consensus.cc:482] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:22:32.640972 28612 raft_consensus.cc:3037] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 1 FOLLOWER]: Advancing to term 2
I20260809 02:22:32.642069 28612 raft_consensus.cc:504] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40059 } }
I20260809 02:22:32.642203 28612 leader_election.cc:302] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: daf7713fd6aa47cea16b66d3f8bc7a83; no voters:
I20260809 02:22:32.642427 28612 leader_election.cc:288] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 02:22:32.642472 28617 raft_consensus.cc:2781] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 02:22:32.642611 28617 raft_consensus.cc:686] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 2 LEADER]: Becoming Leader. State: Replica: daf7713fd6aa47cea16b66d3f8bc7a83, State: Running, Role: LEADER
I20260809 02:22:32.642738 28612 sys_catalog.cc:564] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:22:32.642788 28617 consensus_queue.cc:237] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40059 } }
I20260809 02:22:32.643210 28618 sys_catalog.cc:455] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40059 } } }
I20260809 02:22:32.643231 28619 sys_catalog.cc:455] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [sys.catalog]: SysCatalogTable state changed. Reason: New leader daf7713fd6aa47cea16b66d3f8bc7a83. Latest consensus state: current_term: 2 leader_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40059 } } }
I20260809 02:22:32.643342 28619 sys_catalog.cc:458] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [sys.catalog]: This master's current role is: LEADER
I20260809 02:22:32.643296 28618 sys_catalog.cc:458] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [sys.catalog]: This master's current role is: LEADER
I20260809 02:22:32.643627 28626 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:22:32.644807 28626 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:22:32.644933 28626 catalog_manager.cc:1259] Loaded cluster ID: 7de03ceed9dc413b92343465c7295e3d
I20260809 02:22:32.644976 28626 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:22:32.645797 28626 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:22:32.645998 28626 catalog_manager.cc:5879] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83: Loaded TSK: 0
I20260809 02:22:32.654340 28626 catalog_manager.cc:5868] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83: Generated new TSK 1
I20260809 02:22:32.654451 28626 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 02:22:32.718313 28614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:22:32.718549 28614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:22:32.718586 28614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:22:32.719777 28614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:22:32.719849 28614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:22:32.719894 28614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:22:32.721386 28614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:46173
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=42247
--tserver_master_addrs=127.11.93.190:40059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:22:32.721642 28614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:22:32.721870 28614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:22:32.728152 28642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:32.728242 28641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:32.728283 28614 server_base.cc:1034] running on GCE node
W20260809 02:22:32.728303 28644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:32.728649 28614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:22:32.728904 28614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:22:32.730070 28614 hybrid_clock.cc:648] HybridClock initialized: now 1786242152730057 us; error 31 us; skew 500 ppm
Aug 09 02:22:32 dist-test-slave-w206 krb5kdc[27959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242152, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:22:32.732657 28614 init.cc:377] Logged in from keytab as kudu/127.11.93.129@KRBTEST.COM (short username kudu)
I20260809 02:22:32.733147 28614 webserver.cc:460] Webserver started at http://127.11.93.129:42247/ using document root <none> and password file <none>
I20260809 02:22:32.733425 28614 fs_manager.cc:359] Metadata directory not provided
I20260809 02:22:32.733516 28614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:22:32.734962 28614 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:22:32.735777 28652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:32.735966 28614 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:22:32.736057 28614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "dda693cf80f9444ba9e655c1b3fcd95f"
format_stamp: "Formatted at 2026-08-09 02:22:11 on dist-test-slave-w206"
server_key: "efcce32b2eaac80904a749a00754b9bb"
server_key_iv: "382b40cf50fd715da2329176425fbd64"
server_key_version: "encryptionkey@0"
I20260809 02:22:32.736426 28614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:22:32.749166 28614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:22:32.751652 28614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:22:32.751832 28614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:22:32.752087 28614 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:22:32.752699 28659 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 02:22:32.754652 28614 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 02:22:32.754720 28614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260809 02:22:32.754779 28614 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 02:22:32.755472 28614 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 02:22:32.755532 28614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260809 02:22:32.755594 28659 tablet_bootstrap.cc:492] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f: Bootstrap starting.
I20260809 02:22:32.763303 28614 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:46173
I20260809 02:22:32.763345 28769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:46173 every 8 connection(s)
I20260809 02:22:32.763756 28614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:22:32.767105 28659 log.cc:824] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f: Log is configured to *not* fsync() on all Append() calls
I20260809 02:22:32.768577 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 28614
I20260809 02:22:32.768923 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:36587
--local_ip_for_outbound_sockets=127.11.93.130
--tserver_master_addrs=127.11.93.190:40059
--webserver_port=37943
--webserver_interface=127.11.93.130
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:22:32.769893 28659 tablet_bootstrap.cc:492] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:22:32.770203 28659 tablet_bootstrap.cc:492] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f: Bootstrap complete.
I20260809 02:22:32.771466 28659 ts_tablet_manager.cc:1397] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.015s
I20260809 02:22:32.772905 28659 raft_consensus.cc:348] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } } peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } }
I20260809 02:22:32.773257 28659 raft_consensus.cc:729] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dda693cf80f9444ba9e655c1b3fcd95f, State: Initialized, Role: FOLLOWER
I20260809 02:22:32.773433 28659 consensus_queue.cc:260] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } } peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } }
I20260809 02:22:32.773727 28659 ts_tablet_manager.cc:1428] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
Aug 09 02:22:32 dist-test-slave-w206 krb5kdc[27959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242152, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:22:32.778690 28772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:32.764436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.129:55345)
0809 02:22:32.764625 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:32.764668 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:32.765104 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:32.767725 (+ 2621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:32.767730 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:32.768146 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:22:32.768455 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:32.768462 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:32.770238 (+ 1776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:32.770239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:32.771685 (+ 1446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:32.771688 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:32.772545 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:32.772546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:32.772675 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:32.773353 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:22:32.773362 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:22:32.775035 (+ 1673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:22:32.777048 (+ 2013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:22:32.777055 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:22:32.777057 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:22:32.777290 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:22:32.777558 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:22:32.777559 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:22:32.777560 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:22:32.777672 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:22:32.778040 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:22:32.778047 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:22:32.778185 (+ 138us) client_negotiation.cc:769] Sending connection context
0809 02:22:32.778304 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 02:22:32.778479 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":114,"threads_started":1}
I20260809 02:22:32.778690 28773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:32.764527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:55345 (local address 127.11.93.190:40059)
0809 02:22:32.767229 (+ 2702us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:32.767240 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:32.767289 (+ 49us) server_negotiation.cc:407] Connection header received
0809 02:22:32.767441 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:32.767448 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:32.767511 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:32.768608 (+ 1097us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:22:32.768697 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:32.770088 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:32.771812 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:32.772414 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:32.775112 (+ 2698us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:32.775221 (+ 109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:22:32.775225 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:22:32.775225 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:22:32.775235 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:22:32.776941 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:32.777380 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:32.777383 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:32.777383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:32.777477 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:32.777738 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:32.777739 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:32.777739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:32.777963 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:22:32.778061 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:32.778364 (+ 303us) server_negotiation.cc:299] Negotiation successful
0809 02:22:32.778488 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2622,"thread_start_us":95,"threads_started":1}
I20260809 02:22:32.779618 28770 heartbeater.cc:347] Connected to a master server at 127.11.93.190:40059
I20260809 02:22:32.779733 28770 heartbeater.cc:464] Registering TS with master...
I20260809 02:22:32.779929 28770 heartbeater.cc:511] Master 127.11.93.190:40059 requested a full tablet report, sending...
I20260809 02:22:32.780655 28574 ts_manager.cc:194] Registered new tserver with Master: dda693cf80f9444ba9e655c1b3fcd95f (127.11.93.129:46173)
I20260809 02:22:32.781749 28574 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:55345
I20260809 02:22:32.782588 28770 heartbeater.cc:503] Master 127.11.93.190:40059 was elected leader, sending a full tablet report...
I20260809 02:22:32.790180 28778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:32.781231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:46173 (local address 127.0.0.1:60620)
0809 02:22:32.787098 (+ 5867us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:32.787129 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:32.787185 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:32.787445 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:32.787448 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:32.787450 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:22:32.787522 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:32.787523 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:32.788384 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:32.788385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:32.789175 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:32.789178 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:32.789851 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:32.789852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:32.789937 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:32.789959 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 02:22:32.790049 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 02:22:32.790106 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5830,"thread_start_us":95,"threads_started":1}
I20260809 02:22:32.790191 28779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:32.781472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60620 (local address 127.11.93.129:46173)
0809 02:22:32.787297 (+ 5825us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:32.787301 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:32.787310 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:22:32.787338 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:32.787340 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:32.787351 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:32.787438 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:22:32.787605 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:32.788295 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:32.789284 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:32.789754 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:32.789850 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:32.789909 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:32.790069 (+ 160us) server_negotiation.cc:299] Negotiation successful
0809 02:22:32.790107 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5794,"thread_start_us":72,"threads_started":1}
I20260809 02:22:32.790769 28698 tablet_service.cc:1514] Processing DeleteTablet for tablet 90525bbf2be04bc9ae3dc810ad69e453 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:22:12 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:60620
I20260809 02:22:32.791431 28780 tablet_replica.cc:330] stopping tablet replica
I20260809 02:22:32.791550 28780 raft_consensus.cc:2229] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:22:32.791641 28780 raft_consensus.cc:2258] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:22:32.791954 28780 ts_tablet_manager.cc:1905] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:22:32.794211 28780 ts_tablet_manager.cc:1918] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:22:32.794287 28780 log.cc:1196] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/wal/wals/90525bbf2be04bc9ae3dc810ad69e453
I20260809 02:22:32.794559 28780 ts_tablet_manager.cc:1939] T 90525bbf2be04bc9ae3dc810ad69e453 P dda693cf80f9444ba9e655c1b3fcd95f: Deleting consensus metadata
I20260809 02:22:32.795113 28556 catalog_manager.cc:4841] TS dda693cf80f9444ba9e655c1b3fcd95f (127.11.93.129:46173): tablet 90525bbf2be04bc9ae3dc810ad69e453 (table test-table [id=45ee4ba31cb945cbb9fe384f484431ee]) successfully deleted
W20260809 02:22:32.859862 28776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:22:32.860097 28776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:22:32.860121 28776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:22:32.861219 28776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:22:32.861255 28776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:22:32.861282 28776 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:22:32.862804 28776 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:36587
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=37943
--tserver_master_addrs=127.11.93.190:40059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28776
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:22:32.863071 28776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:22:32.863268 28776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:22:32.868465 28785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:32.868484 28786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:32.868481 28788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:32.868525 28776 server_base.cc:1034] running on GCE node
I20260809 02:22:32.868963 28776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:22:32.869225 28776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:22:32.870391 28776 hybrid_clock.cc:648] HybridClock initialized: now 1786242152870365 us; error 41 us; skew 500 ppm
Aug 09 02:22:32 dist-test-slave-w206 krb5kdc[27959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242152, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:22:32.873183 28776 init.cc:377] Logged in from keytab as kudu/127.11.93.130@KRBTEST.COM (short username kudu)
I20260809 02:22:32.873657 28776 webserver.cc:460] Webserver started at http://127.11.93.130:37943/ using document root <none> and password file <none>
I20260809 02:22:32.873914 28776 fs_manager.cc:359] Metadata directory not provided
I20260809 02:22:32.874003 28776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:22:32.875515 28776 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 02:22:32.876247 28795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:32.876453 28776 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:22:32.876530 28776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "ec3ac562aaa6489d95e48d18a67fa409"
format_stamp: "Formatted at 2026-08-09 02:22:11 on dist-test-slave-w206"
server_key: "375aa72736b451d7adcab5b859c326ef"
server_key_iv: "962e5944c4528c4d2232251d495870cf"
server_key_version: "encryptionkey@0"
I20260809 02:22:32.876871 28776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:22:32.895140 28776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:22:32.897660 28776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:22:32.897778 28776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:22:32.898023 28776 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:22:32.898367 28776 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:22:32.898414 28776 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:32.898442 28776 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:22:32.898458 28776 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:32.904594 28776 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:36587
I20260809 02:22:32.904637 28918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:36587 every 8 connection(s)
I20260809 02:22:32.905004 28776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:22:32.906147 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 28776
I20260809 02:22:32.906471 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:37815
--local_ip_for_outbound_sockets=127.11.93.131
--tserver_master_addrs=127.11.93.190:40059
--webserver_port=35193
--webserver_interface=127.11.93.131
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:22:32 dist-test-slave-w206 krb5kdc[27959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242152, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:22:32.915370 28773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:32.905741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:51447 (local address 127.11.93.190:40059)
0809 02:22:32.905825 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:32.905828 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:32.906080 (+ 252us) server_negotiation.cc:407] Connection header received
0809 02:22:32.906823 (+ 743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:32.906824 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:32.906839 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:32.906892 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:22:32.907971 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:32.908483 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:32.909503 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:32.909820 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:32.909895 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:32.912154 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:22:32.912157 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:22:32.912157 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:22:32.912165 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:22:32.913867 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:32.914248 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:32.914257 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:32.914257 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:32.914324 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:32.914560 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:32.914561 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:32.914561 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:32.914715 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:22:32.914794 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:32.915112 (+ 318us) server_negotiation.cc:299] Negotiation successful
0809 02:22:32.915217 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:22:32.915403 28922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:32.905750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.130:51447)
0809 02:22:32.905940 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:32.905977 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:32.906663 (+ 686us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:32.907000 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:32.907022 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:32.907652 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:22:32.907857 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:32.907862 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:32.908584 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:32.908585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:32.909395 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:32.909397 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:32.909927 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:32.909928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:32.910040 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:32.910590 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:22:32.910599 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:22:32.912049 (+ 1450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:22:32.913953 (+ 1904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:22:32.913960 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:22:32.913962 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:22:32.914172 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:22:32.914395 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:22:32.914396 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:22:32.914396 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:22:32.914491 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:22:32.914803 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:22:32.914807 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:22:32.914919 (+ 112us) client_negotiation.cc:769] Sending connection context
0809 02:22:32.915079 (+ 160us) client_negotiation.cc:240] Negotiation successful
0809 02:22:32.915217 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":110,"threads_started":1}
I20260809 02:22:32.916061 28919 heartbeater.cc:347] Connected to a master server at 127.11.93.190:40059
I20260809 02:22:32.916183 28919 heartbeater.cc:464] Registering TS with master...
I20260809 02:22:32.916406 28919 heartbeater.cc:511] Master 127.11.93.190:40059 requested a full tablet report, sending...
I20260809 02:22:32.916836 28574 ts_manager.cc:194] Registered new tserver with Master: ec3ac562aaa6489d95e48d18a67fa409 (127.11.93.130:36587)
I20260809 02:22:32.917398 28574 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:51447
W20260809 02:22:32.993036 28923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:22:32.993263 28923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:22:32.993289 28923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:22:32.994392 28923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:22:32.994427 28923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:22:32.994452 28923 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:22:32.995908 28923 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:37815
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=35193
--tserver_master_addrs=127.11.93.190:40059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:22:32.996112 28923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:22:32.996297 28923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:22:33.001669 28928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:33.001653 28929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:33.001641 28932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:33.001904 28923 server_base.cc:1034] running on GCE node
I20260809 02:22:33.002110 28923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:22:33.002375 28923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:22:33.003536 28923 hybrid_clock.cc:648] HybridClock initialized: now 1786242153003508 us; error 40 us; skew 500 ppm
Aug 09 02:22:33 dist-test-slave-w206 krb5kdc[27959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242153, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:22:33.006336 28923 init.cc:377] Logged in from keytab as kudu/127.11.93.131@KRBTEST.COM (short username kudu)
I20260809 02:22:33.006875 28923 webserver.cc:460] Webserver started at http://127.11.93.131:35193/ using document root <none> and password file <none>
I20260809 02:22:33.007164 28923 fs_manager.cc:359] Metadata directory not provided
I20260809 02:22:33.007278 28923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:22:33.008824 28923 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:22:33.009475 28940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:33.009660 28923 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:22:33.009773 28923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "45740c812bfb44fb8e8694792410fe99"
format_stamp: "Formatted at 2026-08-09 02:22:12 on dist-test-slave-w206"
server_key: "1d7a75073c46c8b235296bfbbf3917a9"
server_key_iv: "00e301e902329faaa2bf852d9f70ae49"
server_key_version: "encryptionkey@0"
I20260809 02:22:33.010151 28923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:22:33.032256 28923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:22:33.034471 28923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:22:33.034663 28923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:22:33.034952 28923 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:22:33.035373 28923 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:22:33.035435 28923 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:33.035482 28923 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:22:33.035534 28923 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:33.042124 28923 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:37815
I20260809 02:22:33.042243 29058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:37815 every 8 connection(s)
I20260809 02:22:33.042608 28923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:22:33.043087 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 28923
Aug 09 02:22:33 dist-test-slave-w206 krb5kdc[27959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242153, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:22:33.051833 29065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:33.043777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55330 (local address 127.11.93.190:40059)
0809 02:22:33.044035 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:33.044036 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:33.044042 (+ 6us) server_negotiation.cc:407] Connection header received
0809 02:22:33.044080 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:33.044081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:33.044090 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:33.044136 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:22:33.045049 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.045585 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.046536 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.046730 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.046781 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:33.048389 (+ 1608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:22:33.048391 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:22:33.048391 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:22:33.048412 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:22:33.050184 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:33.050857 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:33.050858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:33.050858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:33.050903 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:33.051176 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:33.051177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:33.051178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:33.051324 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:22:33.051532 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:33.051576 (+ 44us) server_negotiation.cc:299] Negotiation successful
0809 02:22:33.051709 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":70,"threads_started":1}
I20260809 02:22:33.053663 28773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:33.043472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:48543 (local address 127.11.93.190:40059)
0809 02:22:33.043550 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:33.043553 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:33.043879 (+ 326us) server_negotiation.cc:407] Connection header received
0809 02:22:33.044621 (+ 742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:33.044622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:33.044629 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:33.044659 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:22:33.045864 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.046357 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.047954 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.048198 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.048249 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:33.050632 (+ 2383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:22:33.050633 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:22:33.050634 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:22:33.050640 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:22:33.052264 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:33.052672 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:33.052673 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:33.052674 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:33.052730 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:33.053020 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:33.053021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:33.053022 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:33.053133 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:22:33.053201 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:33.053495 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 02:22:33.053574 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 02:22:33.053856 29062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:33.043473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.131:48543)
0809 02:22:33.043705 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:33.043759 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:33.044508 (+ 749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:33.044777 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:33.044781 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:33.045492 (+ 711us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:22:33.045762 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:33.045768 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.046459 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.046460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:33.047848 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:33.047852 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.048268 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.048269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:33.048434 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:33.048918 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:22:33.048926 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:22:33.050516 (+ 1590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:22:33.052363 (+ 1847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:22:33.052370 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:22:33.052372 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:22:33.052594 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:22:33.052828 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:22:33.052829 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:22:33.052829 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:22:33.052946 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:22:33.053208 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:22:33.053215 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:22:33.053358 (+ 143us) client_negotiation.cc:769] Sending connection context
0809 02:22:33.053462 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 02:22:33.053618 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":112,"threads_started":1}
I20260809 02:22:33.054360 29059 heartbeater.cc:347] Connected to a master server at 127.11.93.190:40059
I20260809 02:22:33.054497 29059 heartbeater.cc:464] Registering TS with master...
I20260809 02:22:33.054724 29059 heartbeater.cc:511] Master 127.11.93.190:40059 requested a full tablet report, sending...
I20260809 02:22:33.055220 28574 ts_manager.cc:194] Registered new tserver with Master: 45740c812bfb44fb8e8694792410fe99 (127.11.93.131:37815)
I20260809 02:22:33.055616 28574 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:48543
I20260809 02:22:33.063835 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:22:33.066721 28773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:33.064271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55332 (local address 127.11.93.190:40059)
0809 02:22:33.064357 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:33.064359 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:33.064462 (+ 103us) server_negotiation.cc:407] Connection header received
0809 02:22:33.064532 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:33.064533 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:33.064606 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:33.064687 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:22:33.064827 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.065327 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.066114 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.066312 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.066362 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:33.066512 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:22:33.066553 (+ 41us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0809 02:22:33.066671 (+ 118us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55332: token expired
Metrics: {"server-negotiator.queue_time_us":57}
W20260809 02:22:33.066802 28773 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55332: token expired
W20260809 02:22:33.067032 28497 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.11.93.190:40059)
I20260809 02:22:33.073161 28773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:33.067279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55344 (local address 127.11.93.190:40059)
0809 02:22:33.067349 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:33.067351 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:33.067358 (+ 7us) server_negotiation.cc:407] Connection header received
0809 02:22:33.067378 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:33.067379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:33.067387 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:33.067460 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:22:33.067970 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.068404 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.069112 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.069298 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.069372 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:33.070577 (+ 1205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:22:33.070579 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:22:33.070580 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:22:33.070587 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:22:33.071980 (+ 1393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:33.072365 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:33.072366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:33.072366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:33.072430 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:33.072638 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:33.072639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:33.072639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:33.072774 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:22:33.072892 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:33.072991 (+ 99us) server_negotiation.cc:299] Negotiation successful
0809 02:22:33.073066 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:22:33.074431 28574 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55344:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:22:33.076228 28574 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:22:33.078840 28698 tablet_service.cc:1467] Processing CreateTablet for tablet 0e31c13216cf4d2bbab4fd6ad94bafce (DEFAULT_TABLE table=test-table [id=95fa6db9b36c4bd4911f395f94cea8c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:22:33.079100 28698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e31c13216cf4d2bbab4fd6ad94bafce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:22:33.080807 28659 tablet_bootstrap.cc:492] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f: Bootstrap starting.
I20260809 02:22:33.081228 28659 tablet_bootstrap.cc:654] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f: Neither blocks nor log segments found. Creating new log.
I20260809 02:22:33.081947 28659 tablet_bootstrap.cc:492] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f: No bootstrap required, opened a new log
I20260809 02:22:33.082012 28659 ts_tablet_manager.cc:1397] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 02:22:33.082161 28659 raft_consensus.cc:348] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } } peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } }
I20260809 02:22:33.082212 28659 raft_consensus.cc:374] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:22:33.082239 28659 raft_consensus.cc:729] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dda693cf80f9444ba9e655c1b3fcd95f, State: Initialized, Role: FOLLOWER
I20260809 02:22:33.082305 28659 consensus_queue.cc:260] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } } peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } }
I20260809 02:22:33.082422 28659 ts_tablet_manager.cc:1428] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:33.082574 28778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:33.078229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:36587 (local address 127.0.0.1:51254)
0809 02:22:33.078278 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:33.078288 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:33.078323 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:33.078905 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:33.078906 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:33.078908 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:22:33.078950 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:33.078951 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.080160 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.080161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:33.081274 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:33.081277 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.082373 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.082374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:33.082432 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:33.082435 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:22:33.082468 (+ 33us) client_negotiation.cc:240] Negotiation successful
0809 02:22:33.082510 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 02:22:33.082795 29067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:33.078252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:37815 (local address 127.0.0.1:40000)
0809 02:22:33.078448 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:33.078455 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:33.078516 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:33.078944 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:33.078945 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:33.078948 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:22:33.079042 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:33.079044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.080378 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.080380 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:33.081435 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:33.081437 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.082541 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.082545 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:33.082617 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:33.082622 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:22:33.082685 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 02:22:33.082727 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":121,"threads_started":1}
I20260809 02:22:33.082901 29069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:33.078534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40000 (local address 127.11.93.131:37815)
0809 02:22:33.078749 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:33.078754 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:33.078764 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:22:33.078812 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:33.078814 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:33.078829 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:33.079125 (+ 296us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:22:33.079218 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.080294 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.081522 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.082278 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.082377 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:33.082441 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:33.082766 (+ 325us) server_negotiation.cc:299] Negotiation successful
0809 02:22:33.082813 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":139,"threads_started":1}
I20260809 02:22:33.083304 29068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:33.078530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51254 (local address 127.11.93.130:36587)
0809 02:22:33.078716 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:33.078722 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:33.078732 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:22:33.078785 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:33.078787 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:33.078812 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:33.078906 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:22:33.079047 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.080075 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.081424 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.082264 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.083073 (+ 809us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:33.083145 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:33.083169 (+ 24us) server_negotiation.cc:299] Negotiation successful
0809 02:22:33.083210 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":85,"threads_started":1}
I20260809 02:22:33.083724 28989 tablet_service.cc:1467] Processing CreateTablet for tablet 0e31c13216cf4d2bbab4fd6ad94bafce (DEFAULT_TABLE table=test-table [id=95fa6db9b36c4bd4911f395f94cea8c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:22:33.083941 28848 tablet_service.cc:1467] Processing CreateTablet for tablet 0e31c13216cf4d2bbab4fd6ad94bafce (DEFAULT_TABLE table=test-table [id=95fa6db9b36c4bd4911f395f94cea8c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:22:33.084064 28989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e31c13216cf4d2bbab4fd6ad94bafce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:22:33.084286 28848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e31c13216cf4d2bbab4fd6ad94bafce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:22:33.086908 29071 tablet_bootstrap.cc:492] T 0e31c13216cf4d2bbab4fd6ad94bafce P 45740c812bfb44fb8e8694792410fe99: Bootstrap starting.
I20260809 02:22:33.087294 29072 tablet_bootstrap.cc:492] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409: Bootstrap starting.
I20260809 02:22:33.087670 29071 tablet_bootstrap.cc:654] T 0e31c13216cf4d2bbab4fd6ad94bafce P 45740c812bfb44fb8e8694792410fe99: Neither blocks nor log segments found. Creating new log.
I20260809 02:22:33.087982 29072 tablet_bootstrap.cc:654] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409: Neither blocks nor log segments found. Creating new log.
I20260809 02:22:33.088411 29071 log.cc:824] T 0e31c13216cf4d2bbab4fd6ad94bafce P 45740c812bfb44fb8e8694792410fe99: Log is configured to *not* fsync() on all Append() calls
I20260809 02:22:33.089367 29071 tablet_bootstrap.cc:492] T 0e31c13216cf4d2bbab4fd6ad94bafce P 45740c812bfb44fb8e8694792410fe99: No bootstrap required, opened a new log
I20260809 02:22:33.089450 29071 ts_tablet_manager.cc:1397] T 0e31c13216cf4d2bbab4fd6ad94bafce P 45740c812bfb44fb8e8694792410fe99: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260809 02:22:33.091063 29072 log.cc:824] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409: Log is configured to *not* fsync() on all Append() calls
I20260809 02:22:33.091759 29071 raft_consensus.cc:348] T 0e31c13216cf4d2bbab4fd6ad94bafce P 45740c812bfb44fb8e8694792410fe99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } } peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } }
I20260809 02:22:33.091917 29072 tablet_bootstrap.cc:492] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409: No bootstrap required, opened a new log
I20260809 02:22:33.091943 29071 raft_consensus.cc:374] T 0e31c13216cf4d2bbab4fd6ad94bafce P 45740c812bfb44fb8e8694792410fe99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:22:33.091974 29072 ts_tablet_manager.cc:1397] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260809 02:22:33.091980 29071 raft_consensus.cc:729] T 0e31c13216cf4d2bbab4fd6ad94bafce P 45740c812bfb44fb8e8694792410fe99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45740c812bfb44fb8e8694792410fe99, State: Initialized, Role: FOLLOWER
I20260809 02:22:33.092147 29071 consensus_queue.cc:260] T 0e31c13216cf4d2bbab4fd6ad94bafce P 45740c812bfb44fb8e8694792410fe99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } } peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } }
I20260809 02:22:33.092465 29071 ts_tablet_manager.cc:1428] T 0e31c13216cf4d2bbab4fd6ad94bafce P 45740c812bfb44fb8e8694792410fe99: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260809 02:22:33.092543 29059 heartbeater.cc:503] Master 127.11.93.190:40059 was elected leader, sending a full tablet report...
I20260809 02:22:33.094177 29072 raft_consensus.cc:348] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } } peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } }
I20260809 02:22:33.094368 29072 raft_consensus.cc:374] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:22:33.094424 29072 raft_consensus.cc:729] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec3ac562aaa6489d95e48d18a67fa409, State: Initialized, Role: FOLLOWER
I20260809 02:22:33.094547 29072 consensus_queue.cc:260] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } } peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } }
I20260809 02:22:33.095078 28919 heartbeater.cc:503] Master 127.11.93.190:40059 was elected leader, sending a full tablet report...
I20260809 02:22:33.095068 29072 ts_tablet_manager.cc:1428] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
W20260809 02:22:33.155596 28921 tablet.cc:2369] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:22:33.236101 29077 raft_consensus.cc:482] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:22:33.236231 29077 raft_consensus.cc:504] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } } peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } }
I20260809 02:22:33.236589 29077 leader_election.cc:288] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45740c812bfb44fb8e8694792410fe99 (127.11.93.131:37815), dda693cf80f9444ba9e655c1b3fcd95f (127.11.93.129:46173)
I20260809 02:22:33.240628 29069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:33.236843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:54633 (local address 127.11.93.131:37815)
0809 02:22:33.236908 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:33.236909 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:33.236920 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:22:33.237007 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:33.237008 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:33.237017 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:33.237097 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:22:33.237345 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.238091 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.239635 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.240229 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.240311 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:33.240323 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:33.240505 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 02:22:33.240552 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:22:33.240669 28922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:33.236783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:37815 (local address 127.11.93.130:54633)
0809 02:22:33.236857 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:33.236868 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:33.236914 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:33.237113 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:33.237114 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:33.237116 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:22:33.237211 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:33.237212 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.238180 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.238180 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:33.239518 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:33.239522 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.240345 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.240346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:33.240414 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:33.240418 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:22:33.240484 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 02:22:33.240540 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":44}
I20260809 02:22:33.240659 28779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:33.236893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:35381 (local address 127.11.93.129:46173)
0809 02:22:33.236946 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:33.236949 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:33.237067 (+ 118us) server_negotiation.cc:407] Connection header received
0809 02:22:33.237116 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:33.237117 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:33.237126 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:33.237180 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:22:33.237337 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.238092 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.239619 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.240226 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.240357 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:33.240367 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:33.240542 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 02:22:33.240582 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 02:22:33.240700 29078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:33.236825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:46173 (local address 127.11.93.130:35381)
0809 02:22:33.236986 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:33.236995 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:33.237050 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:33.237200 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:33.237200 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:33.237201 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:22:33.237263 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:33.237264 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.238180 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.238180 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:33.239518 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:33.239522 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.240380 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.240381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:33.240463 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:33.240466 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:22:33.240536 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 02:22:33.240581 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":44,"thread_start_us":99,"threads_started":1}
I20260809 02:22:33.241097 29009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e31c13216cf4d2bbab4fd6ad94bafce" candidate_uuid: "ec3ac562aaa6489d95e48d18a67fa409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45740c812bfb44fb8e8694792410fe99" is_pre_election: true
I20260809 02:22:33.241104 28723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e31c13216cf4d2bbab4fd6ad94bafce" candidate_uuid: "ec3ac562aaa6489d95e48d18a67fa409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" is_pre_election: true
I20260809 02:22:33.241276 29009 raft_consensus.cc:2454] T 0e31c13216cf4d2bbab4fd6ad94bafce P 45740c812bfb44fb8e8694792410fe99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec3ac562aaa6489d95e48d18a67fa409 in term 0.
I20260809 02:22:33.241348 28723 raft_consensus.cc:2454] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec3ac562aaa6489d95e48d18a67fa409 in term 0.
I20260809 02:22:33.241540 28798 leader_election.cc:302] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45740c812bfb44fb8e8694792410fe99, ec3ac562aaa6489d95e48d18a67fa409; no voters:
I20260809 02:22:33.241703 29077 raft_consensus.cc:2781] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:22:33.241768 29077 raft_consensus.cc:482] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:22:33.241804 29077 raft_consensus.cc:3037] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:22:33.242556 29077 raft_consensus.cc:504] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } } peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } }
I20260809 02:22:33.242712 29077 leader_election.cc:288] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409 [CANDIDATE]: Term 1 election: Requested vote from peers 45740c812bfb44fb8e8694792410fe99 (127.11.93.131:37815), dda693cf80f9444ba9e655c1b3fcd95f (127.11.93.129:46173)
I20260809 02:22:33.242869 29009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e31c13216cf4d2bbab4fd6ad94bafce" candidate_uuid: "ec3ac562aaa6489d95e48d18a67fa409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45740c812bfb44fb8e8694792410fe99"
I20260809 02:22:33.242926 28723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e31c13216cf4d2bbab4fd6ad94bafce" candidate_uuid: "ec3ac562aaa6489d95e48d18a67fa409" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dda693cf80f9444ba9e655c1b3fcd95f"
I20260809 02:22:33.242945 29009 raft_consensus.cc:3037] T 0e31c13216cf4d2bbab4fd6ad94bafce P 45740c812bfb44fb8e8694792410fe99 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:22:33.243049 28723 raft_consensus.cc:3037] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:22:33.243872 29009 raft_consensus.cc:2454] T 0e31c13216cf4d2bbab4fd6ad94bafce P 45740c812bfb44fb8e8694792410fe99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec3ac562aaa6489d95e48d18a67fa409 in term 1.
I20260809 02:22:33.244036 28798 leader_election.cc:302] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45740c812bfb44fb8e8694792410fe99, ec3ac562aaa6489d95e48d18a67fa409; no voters:
I20260809 02:22:33.244120 29077 raft_consensus.cc:2781] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:22:33.244279 29077 raft_consensus.cc:686] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409 [term 1 LEADER]: Becoming Leader. State: Replica: ec3ac562aaa6489d95e48d18a67fa409, State: Running, Role: LEADER
I20260809 02:22:33.244418 29077 consensus_queue.cc:237] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } } peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } }
I20260809 02:22:33.244484 28723 raft_consensus.cc:2454] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec3ac562aaa6489d95e48d18a67fa409 in term 1.
I20260809 02:22:33.245230 28574 catalog_manager.cc:5495] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec3ac562aaa6489d95e48d18a67fa409 (127.11.93.130). New cstate: current_term: 1 leader_uuid: "ec3ac562aaa6489d95e48d18a67fa409" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } health_report { overall_health: UNKNOWN } } }
W20260809 02:22:33.267897 28771 tablet.cc:2369] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:22:33.274721 29068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:33.271936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51258 (local address 127.11.93.130:36587)
0809 02:22:33.272032 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:33.272035 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:33.272045 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:22:33.272087 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:33.272088 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:33.272109 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:33.272205 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:22:33.272332 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.272908 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.273691 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:33.273888 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:33.273968 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:33.274175 (+ 207us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:22:33.274321 (+ 146us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:22:33.274393 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:33.274488 (+ 95us) server_negotiation.cc:299] Negotiation successful
0809 02:22:33.274511 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 02:22:33.276779 29009 raft_consensus.cc:1261] T 0e31c13216cf4d2bbab4fd6ad94bafce P 45740c812bfb44fb8e8694792410fe99 [term 1 FOLLOWER]: Refusing update from remote peer ec3ac562aaa6489d95e48d18a67fa409: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:22:33.276779 28723 raft_consensus.cc:1261] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Refusing update from remote peer ec3ac562aaa6489d95e48d18a67fa409: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:22:33.277163 29077 consensus_queue.cc:1035] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:22:33.277356 29079 consensus_queue.cc:1035] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:22:33.279371 29082 mvcc.cc:205] Tried to move back new op lower bound from 7316447859818610688 to 7316447859689713664. Current Snapshot: MvccSnapshot[applied={T|T < 7316447859818610688}]
I20260809 02:22:33.279439 29083 mvcc.cc:205] Tried to move back new op lower bound from 7316447859818610688 to 7316447859689713664. Current Snapshot: MvccSnapshot[applied={T|T < 7316447859818610688}]
I20260809 02:22:33.281672 28574 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55344:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:22:33.281765 28574 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55344:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:22:33.282521 28574 catalog_manager.cc:5782] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83: Sending DeleteTablet for 3 replicas of tablet 0e31c13216cf4d2bbab4fd6ad94bafce
I20260809 02:22:33.282866 28698 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e31c13216cf4d2bbab4fd6ad94bafce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:22:33 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:60620
I20260809 02:22:33.282876 28848 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e31c13216cf4d2bbab4fd6ad94bafce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:22:33 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:51254
I20260809 02:22:33.282914 28989 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e31c13216cf4d2bbab4fd6ad94bafce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:22:33 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:40000
I20260809 02:22:33.283010 28780 tablet_replica.cc:330] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f: stopping tablet replica
I20260809 02:22:33.283083 28780 raft_consensus.cc:2229] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:22:33.283116 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 28614
I20260809 02:22:33.283133 28780 raft_consensus.cc:2258] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:22:33.284538 29093 tablet_replica.cc:330] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409: stopping tablet replica
I20260809 02:22:33.284639 29093 raft_consensus.cc:2229] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:22:33.284726 29093 raft_consensus.cc:2258] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:22:33.284926 29094 tablet_replica.cc:330] T 0e31c13216cf4d2bbab4fd6ad94bafce P 45740c812bfb44fb8e8694792410fe99: stopping tablet replica
I20260809 02:22:33.285049 29094 raft_consensus.cc:2229] T 0e31c13216cf4d2bbab4fd6ad94bafce P 45740c812bfb44fb8e8694792410fe99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:22:33.285205 29094 raft_consensus.cc:2258] T 0e31c13216cf4d2bbab4fd6ad94bafce P 45740c812bfb44fb8e8694792410fe99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:22:33.285923 29093 ts_tablet_manager.cc:1905] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:22:33.288546 29093 ts_tablet_manager.cc:1918] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:22:33.288661 29093 log.cc:1196] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/0e31c13216cf4d2bbab4fd6ad94bafce
I20260809 02:22:33.289103 29093 ts_tablet_manager.cc:1939] T 0e31c13216cf4d2bbab4fd6ad94bafce P ec3ac562aaa6489d95e48d18a67fa409: Deleting consensus metadata
I20260809 02:22:33.289618 28558 catalog_manager.cc:4841] TS ec3ac562aaa6489d95e48d18a67fa409 (127.11.93.130:36587): tablet 0e31c13216cf4d2bbab4fd6ad94bafce (table test-table [id=95fa6db9b36c4bd4911f395f94cea8c1]) successfully deleted
I20260809 02:22:33.289969 29094 ts_tablet_manager.cc:1905] T 0e31c13216cf4d2bbab4fd6ad94bafce P 45740c812bfb44fb8e8694792410fe99: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:22:33.292346 29094 ts_tablet_manager.cc:1918] T 0e31c13216cf4d2bbab4fd6ad94bafce P 45740c812bfb44fb8e8694792410fe99: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:22:33.292443 29094 log.cc:1196] T 0e31c13216cf4d2bbab4fd6ad94bafce P 45740c812bfb44fb8e8694792410fe99: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/0e31c13216cf4d2bbab4fd6ad94bafce
I20260809 02:22:33.292863 29094 ts_tablet_manager.cc:1939] T 0e31c13216cf4d2bbab4fd6ad94bafce P 45740c812bfb44fb8e8694792410fe99: Deleting consensus metadata
I20260809 02:22:33.293496 28557 catalog_manager.cc:4841] TS 45740c812bfb44fb8e8694792410fe99 (127.11.93.131:37815): tablet 0e31c13216cf4d2bbab4fd6ad94bafce (table test-table [id=95fa6db9b36c4bd4911f395f94cea8c1]) successfully deleted
W20260809 02:22:33.295215 28556 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.93.129:46173 (error 108)
W20260809 02:22:33.296087 29067 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:22:33.295672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:46173 (local address 127.0.0.1:60634)
0809 02:22:33.295739 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:33.295754 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:33.295805 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:33.296031 (+ 226us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.129:46173: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 02:22:33.296247 28556 catalog_manager.cc:4584] TS dda693cf80f9444ba9e655c1b3fcd95f (127.11.93.129:46173): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0e31c13216cf4d2bbab4fd6ad94bafce: Network error: Client connection negotiation failed: client connection to 127.11.93.129:46173: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 02:22:33.296934 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 28776
I20260809 02:22:33.303457 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 28923
I20260809 02:22:33.309702 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 28539
I20260809 02:22:53.316515 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:40059
--webserver_interface=127.11.93.190
--webserver_port=43267
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:40059
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:22:53.403035 29096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:22:53.403277 29096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:22:53.403303 29096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:22:53.404641 29096 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 02:22:53.404691 29096 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 02:22:53.404707 29096 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 02:22:53.404721 29096 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:22:53.404735 29096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:22:53.404825 29096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:22:53.404898 29096 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:22:53.404923 29096 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:22:53.406927 29096 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:40059
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:40059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=43267
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:22:53.407263 29096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:22:53.407517 29096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:22:53.413504 29101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:53.413506 29104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:53.413542 29096 server_base.cc:1034] running on GCE node
W20260809 02:22:53.413520 29102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:53.414009 29096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:22:53.414335 29096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:22:53.415499 29096 hybrid_clock.cc:648] HybridClock initialized: now 1786242173415481 us; error 41 us; skew 500 ppm
Aug 09 02:22:53 dist-test-slave-w206 krb5kdc[27959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242173, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:22:53.418746 29096 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:22:53.419361 29096 webserver.cc:460] Webserver started at http://127.11.93.190:43267/ using document root <none> and password file <none>
I20260809 02:22:53.419595 29096 fs_manager.cc:359] Metadata directory not provided
I20260809 02:22:53.419651 29096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:22:53.421262 29096 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 02:22:53.422045 29111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:53.422334 29096 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:22:53.422434 29096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "daf7713fd6aa47cea16b66d3f8bc7a83"
format_stamp: "Formatted at 2026-08-09 02:22:11 on dist-test-slave-w206"
server_key: "04e2deba78f51b0a4c6127e7706bb39b"
server_key_iv: "0758fc4262393071be52afa6b5cc212f"
server_key_version: "encryptionkey@0"
I20260809 02:22:53.422873 29096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:22:53.453389 29096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:22:53.455973 29096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:22:53.456097 29096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:22:53.460675 29096 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:40059
I20260809 02:22:53.460713 29165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:40059 every 8 connection(s)
I20260809 02:22:53.461127 29096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:22:53.462621 29166 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:22:53.463271 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 29096
I20260809 02:22:53.463393 29166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83: Bootstrap starting.
I20260809 02:22:53.463608 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:46173
--local_ip_for_outbound_sockets=127.11.93.129
--tserver_master_addrs=127.11.93.190:40059
--webserver_port=42247
--webserver_interface=127.11.93.129
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:22:53.472023 29166 log.cc:824] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83: Log is configured to *not* fsync() on all Append() calls
I20260809 02:22:53.474267 29166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:22:53.474583 29166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83: Bootstrap complete.
I20260809 02:22:53.476895 29166 raft_consensus.cc:348] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40059 } }
I20260809 02:22:53.477144 29166 raft_consensus.cc:729] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: daf7713fd6aa47cea16b66d3f8bc7a83, State: Initialized, Role: FOLLOWER
I20260809 02:22:53.477325 29166 consensus_queue.cc:260] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40059 } }
I20260809 02:22:53.477403 29166 raft_consensus.cc:388] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:22:53.477456 29166 raft_consensus.cc:482] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:22:53.477504 29166 raft_consensus.cc:3037] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 2 FOLLOWER]: Advancing to term 3
I20260809 02:22:53.478509 29166 raft_consensus.cc:504] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40059 } }
I20260809 02:22:53.478638 29166 leader_election.cc:302] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: daf7713fd6aa47cea16b66d3f8bc7a83; no voters:
I20260809 02:22:53.478845 29166 leader_election.cc:288] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 02:22:53.478883 29170 raft_consensus.cc:2781] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 02:22:53.479091 29170 raft_consensus.cc:686] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [term 3 LEADER]: Becoming Leader. State: Replica: daf7713fd6aa47cea16b66d3f8bc7a83, State: Running, Role: LEADER
I20260809 02:22:53.479161 29166 sys_catalog.cc:564] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:22:53.479245 29170 consensus_queue.cc:237] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40059 } }
I20260809 02:22:53.479534 29170 sys_catalog.cc:455] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [sys.catalog]: SysCatalogTable state changed. Reason: New leader daf7713fd6aa47cea16b66d3f8bc7a83. Latest consensus state: current_term: 3 leader_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40059 } } }
I20260809 02:22:53.479640 29170 sys_catalog.cc:458] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [sys.catalog]: This master's current role is: LEADER
I20260809 02:22:53.479540 29172 sys_catalog.cc:455] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "daf7713fd6aa47cea16b66d3f8bc7a83" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40059 } } }
I20260809 02:22:53.479846 29172 sys_catalog.cc:458] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83 [sys.catalog]: This master's current role is: LEADER
I20260809 02:22:53.481192 29187 catalog_manager.cc:1259] Loaded cluster ID: 7de03ceed9dc413b92343465c7295e3d
I20260809 02:22:53.481242 29187 catalog_manager.cc:1552] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83: loading cluster ID for follower catalog manager: success
I20260809 02:22:53.482466 29187 catalog_manager.cc:1574] T 00000000000000000000000000000000 P daf7713fd6aa47cea16b66d3f8bc7a83: acquiring CA information for follower catalog manager: success
F20260809 02:22:53.482856 29187 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fd7482c99ad google::LogMessage::Fail() at ??:0
@ 0x7fd7482cc88a google::LogMessage::SendToLog() at ??:0
@ 0x7fd7482c94de google::LogMessage::Flush() at ??:0
@ 0x7fd7482caa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fd74aa36104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fd7502226b9 kudu::master::CatalogManager::LoadTspkEntries() at ??:0
@ 0x7fd750222989 kudu::master::CatalogManager::PrepareFollowerTokenVerifier() at ??:0
@ 0x7fd750222e4e kudu::master::CatalogManager::PrepareFollower() at ??:0
@ 0x7fd7502258c2 kudu::master::CatalogManagerBgTasks::Run() at ??:0
@ 0x7fd74a18c954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fd74aff06db start_thread at ??:0
@ 0x7fd746dc761f clone at ??:0
W20260809 02:22:53.585076 29168 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:22:53.585393 29168 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:22:53.585430 29168 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:22:53.587199 29168 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:22:53.587257 29168 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:22:53.587301 29168 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:22:53.589496 29168 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:46173
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=42247
--tserver_master_addrs=127.11.93.190:40059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29168
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:22:53.589753 29168 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:22:53.590013 29168 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:22:53.595588 29212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:53.595642 29210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:53.595590 29209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:53.595781 29168 server_base.cc:1034] running on GCE node
I20260809 02:22:53.596076 29168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:22:53.596410 29168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:22:53.597604 29168 hybrid_clock.cc:648] HybridClock initialized: now 1786242173597590 us; error 49 us; skew 500 ppm
Aug 09 02:22:53 dist-test-slave-w206 krb5kdc[27959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242173, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:22:53.600906 29168 init.cc:377] Logged in from keytab as kudu/127.11.93.129@KRBTEST.COM (short username kudu)
I20260809 02:22:53.601477 29168 webserver.cc:460] Webserver started at http://127.11.93.129:42247/ using document root <none> and password file <none>
I20260809 02:22:53.601751 29168 fs_manager.cc:359] Metadata directory not provided
I20260809 02:22:53.601824 29168 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:22:53.603730 29168 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:22:53.604497 29219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:53.604691 29168 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:22:53.604785 29168 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "dda693cf80f9444ba9e655c1b3fcd95f"
format_stamp: "Formatted at 2026-08-09 02:22:11 on dist-test-slave-w206"
server_key: "efcce32b2eaac80904a749a00754b9bb"
server_key_iv: "382b40cf50fd715da2329176425fbd64"
server_key_version: "encryptionkey@0"
I20260809 02:22:53.605258 29168 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:22:53.640544 29168 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:22:53.643163 29168 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:22:53.643324 29168 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:22:53.643613 29168 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:22:53.644079 29226 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 02:22:53.646152 29168 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 02:22:53.646229 29168 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260809 02:22:53.646276 29168 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 02:22:53.646914 29168 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 02:22:53.646971 29168 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260809 02:22:53.647055 29226 tablet_bootstrap.cc:492] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f: Bootstrap starting.
I20260809 02:22:53.654325 29168 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:46173
I20260809 02:22:53.654388 29346 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:46173 every 8 connection(s)
I20260809 02:22:53.654803 29168 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:22:53.658159 29226 log.cc:824] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f: Log is configured to *not* fsync() on all Append() calls
I20260809 02:22:53.660341 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 29168
I20260809 02:22:53.660668 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:36587
--local_ip_for_outbound_sockets=127.11.93.130
--tserver_master_addrs=127.11.93.190:40059
--webserver_port=37943
--webserver_interface=127.11.93.130
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:22:53.660980 29226 tablet_bootstrap.cc:492] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:22:53.661352 29226 tablet_bootstrap.cc:492] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f: Bootstrap complete.
I20260809 02:22:53.662613 29226 ts_tablet_manager.cc:1397] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.005s
I20260809 02:22:53.664108 29226 raft_consensus.cc:348] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } } peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } }
I20260809 02:22:53.664439 29226 raft_consensus.cc:729] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dda693cf80f9444ba9e655c1b3fcd95f, State: Initialized, Role: FOLLOWER
I20260809 02:22:53.664640 29226 consensus_queue.cc:260] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } } peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } }
I20260809 02:22:53.664947 29226 ts_tablet_manager.cc:1428] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
W20260809 02:22:53.714537 29349 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:22:53.655544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.129:37857)
0809 02:22:53.655717 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:53.655760 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:53.656203 (+ 443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:53.714329 (+ 58126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":102,"threads_started":1}
W20260809 02:22:53.714771 29347 heartbeater.cc:644] Failed to heartbeat to 127.11.93.190:40059 (0 consecutive failures): Network error: Failed to ping master at 127.11.93.190:40059: Client connection negotiation failed: client connection to 127.11.93.190:40059: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 02:22:53.715158 29349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:53.715039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.129:51507)
0809 02:22:53.715090 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:53.715138 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260809 02:22:53.715551 29349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:53.715449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.129:39555)
0809 02:22:53.715499 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:53.715525 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260809 02:22:53.715682 29347 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:22:53.746809 29351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:22:53.747121 29351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:22:53.747167 29351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:22:53.748468 29351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:22:53.748528 29351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:22:53.748574 29351 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:22:53.750204 29351 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:36587
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=37943
--tserver_master_addrs=127.11.93.190:40059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:22:53.750473 29351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:22:53.750705 29351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:22:53.756111 29357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:53.756196 29362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:53.756100 29358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:53.756551 29351 server_base.cc:1034] running on GCE node
I20260809 02:22:53.756772 29351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:22:53.757045 29351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:22:53.758252 29351 hybrid_clock.cc:648] HybridClock initialized: now 1786242173758260 us; error 52 us; skew 500 ppm
Aug 09 02:22:53 dist-test-slave-w206 krb5kdc[27959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242173, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:22:53.761124 29351 init.cc:377] Logged in from keytab as kudu/127.11.93.130@KRBTEST.COM (short username kudu)
I20260809 02:22:53.761673 29351 webserver.cc:460] Webserver started at http://127.11.93.130:37943/ using document root <none> and password file <none>
I20260809 02:22:53.761932 29351 fs_manager.cc:359] Metadata directory not provided
I20260809 02:22:53.762012 29351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:22:53.763607 29351 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:22:53.764276 29369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:53.764475 29351 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:22:53.764593 29351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "ec3ac562aaa6489d95e48d18a67fa409"
format_stamp: "Formatted at 2026-08-09 02:22:11 on dist-test-slave-w206"
server_key: "375aa72736b451d7adcab5b859c326ef"
server_key_iv: "962e5944c4528c4d2232251d495870cf"
server_key_version: "encryptionkey@0"
I20260809 02:22:53.764982 29351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:22:53.794216 29351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:22:53.796406 29351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:22:53.796607 29351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:22:53.796880 29351 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:22:53.797242 29351 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:22:53.797305 29351 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:53.797353 29351 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:22:53.797403 29351 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:53.804248 29351 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:36587
I20260809 02:22:53.804286 29490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:36587 every 8 connection(s)
I20260809 02:22:53.804667 29351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:22:53.805732 29493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:53.805316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.130:40479)
0809 02:22:53.805502 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:53.805577 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":97,"threads_started":1}
W20260809 02:22:53.806142 29491 heartbeater.cc:644] Failed to heartbeat to 127.11.93.190:40059 (0 consecutive failures): Network error: Failed to ping master at 127.11.93.190:40059: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
I20260809 02:22:53.806500 29493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:53.806406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.130:56639)
0809 02:22:53.806453 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:53.806481 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 02:22:53.806825 29493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:53.806743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.130:39479)
0809 02:22:53.806769 (+ 26us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:53.806789 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260809 02:22:53.806946 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 29351
W20260809 02:22:53.807016 29491 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 02:22:53.807281 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:37815
--local_ip_for_outbound_sockets=127.11.93.131
--tserver_master_addrs=127.11.93.190:40059
--webserver_port=35193
--webserver_interface=127.11.93.131
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:22:53.891551 29494 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:22:53.891762 29494 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:22:53.891784 29494 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:22:53.892870 29494 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:22:53.892905 29494 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:22:53.892931 29494 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:22:53.894326 29494 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:37815
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=35193
--tserver_master_addrs=127.11.93.190:40059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29494
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:22:53.894517 29494 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:22:53.894699 29494 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:22:53.899757 29500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:53.899775 29501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:22:53.899757 29503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:22:53.900018 29494 server_base.cc:1034] running on GCE node
I20260809 02:22:53.900493 29494 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:22:53.900782 29494 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:22:53.901937 29494 hybrid_clock.cc:648] HybridClock initialized: now 1786242173901912 us; error 36 us; skew 500 ppm
Aug 09 02:22:53 dist-test-slave-w206 krb5kdc[27959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242173, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:22:53.904651 29494 init.cc:377] Logged in from keytab as kudu/127.11.93.131@KRBTEST.COM (short username kudu)
I20260809 02:22:53.905056 29494 webserver.cc:460] Webserver started at http://127.11.93.131:35193/ using document root <none> and password file <none>
I20260809 02:22:53.905310 29494 fs_manager.cc:359] Metadata directory not provided
I20260809 02:22:53.905382 29494 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:22:53.906746 29494 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:22:53.907531 29510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:53.907714 29494 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 02:22:53.907814 29494 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "45740c812bfb44fb8e8694792410fe99"
format_stamp: "Formatted at 2026-08-09 02:22:12 on dist-test-slave-w206"
server_key: "1d7a75073c46c8b235296bfbbf3917a9"
server_key_iv: "00e301e902329faaa2bf852d9f70ae49"
server_key_version: "encryptionkey@0"
I20260809 02:22:53.908166 29494 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:22:53.941098 29494 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:22:53.943684 29494 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:22:53.943871 29494 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:22:53.944136 29494 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:22:53.944468 29494 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:22:53.944525 29494 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:53.944566 29494 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:22:53.944609 29494 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:22:53.950627 29494 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:37815
I20260809 02:22:53.950712 29633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:37815 every 8 connection(s)
I20260809 02:22:53.951113 29494 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:22:53.952226 29636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:53.951845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.131:41213)
0809 02:22:53.952013 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:53.952087 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":81,"threads_started":1}
W20260809 02:22:53.952653 29634 heartbeater.cc:644] Failed to heartbeat to 127.11.93.190:40059 (0 consecutive failures): Network error: Failed to ping master at 127.11.93.190:40059: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
I20260809 02:22:53.952950 29636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:53.952861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.131:53735)
0809 02:22:53.952905 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:53.952932 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260809 02:22:53.953281 29636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:53.953225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.131:46877)
0809 02:22:53.953246 (+ 21us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:53.953266 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260809 02:22:53.953419 29634 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 02:22:53.954000 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 29494
I20260809 02:22:54.716259 29638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:54.716022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.129:58341)
0809 02:22:54.716150 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:54.716189 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":63,"threads_started":1}
I20260809 02:22:54.807611 29639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:54.807381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.130:45797)
0809 02:22:54.807516 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:54.807556 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":59,"threads_started":1}
I20260809 02:22:54.954030 29640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:54.953782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.131:39373)
0809 02:22:54.953923 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:54.953971 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":58,"threads_started":1}
I20260809 02:22:55.124739 29641 raft_consensus.cc:482] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:22:55.124872 29641 raft_consensus.cc:504] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } } peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } }
I20260809 02:22:55.125289 29641 leader_election.cc:288] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec3ac562aaa6489d95e48d18a67fa409 (127.11.93.130:36587), 45740c812bfb44fb8e8694792410fe99 (127.11.93.131:37815)
Aug 09 02:22:55 dist-test-slave-w206 krb5kdc[27959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242173, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.131@KRBTEST.COM
Aug 09 02:22:55 dist-test-slave-w206 krb5kdc[27959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242173, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.130@KRBTEST.COM
I20260809 02:22:55.135866 29638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:55.125426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:36587 (local address 127.11.93.129:56915)
0809 02:22:55.125486 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:55.125498 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:55.125570 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:55.126435 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:55.126438 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:55.126809 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:22:55.127097 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:55.127104 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:55.128327 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:55.128328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:55.129082 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:55.129084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:55.129681 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:55.129683 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:55.129805 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:55.130463 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:22:55.130468 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:22:55.132365 (+ 1897us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:22:55.134275 (+ 1910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:22:55.134277 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:22:55.134277 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:22:55.134559 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:22:55.134815 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:22:55.134815 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:22:55.134816 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:22:55.134944 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:22:55.135360 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:22:55.135367 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:22:55.135499 (+ 132us) client_negotiation.cc:769] Sending connection context
0809 02:22:55.135600 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 02:22:55.135763 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 02:22:55.136029 29643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:55.125529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:56915 (local address 127.11.93.130:36587)
0809 02:22:55.125705 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:55.125715 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:55.125742 (+ 27us) server_negotiation.cc:407] Connection header received
0809 02:22:55.126194 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:55.126196 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:55.126240 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:55.126396 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:22:55.127227 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:55.128219 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:55.129183 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:55.129588 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:55.129711 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:55.132477 (+ 2766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:22:55.132480 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:22:55.132480 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:22:55.132490 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:22:55.134173 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:55.134644 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:55.134647 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:55.134648 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:55.134741 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:55.135051 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:55.135052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:55.135053 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:55.135276 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:22:55.135367 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:55.135772 (+ 405us) server_negotiation.cc:299] Negotiation successful
0809 02:22:55.135898 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":90,"threads_started":1}
I20260809 02:22:55.136040 29644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:55.125649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:46069 (local address 127.11.93.131:37815)
0809 02:22:55.125763 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 02:22:55.125780 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 02:22:55.126599 (+ 819us) server_negotiation.cc:407] Connection header received
0809 02:22:55.127107 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:22:55.127109 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:22:55.127147 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:22:55.127261 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:22:55.127611 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:55.128445 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:55.129235 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:22:55.129622 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:22:55.129740 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:55.132092 (+ 2352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:22:55.132098 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:22:55.132098 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:22:55.132111 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:22:55.134145 (+ 2034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:55.134652 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:55.134656 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:55.134657 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:55.134740 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:22:55.135043 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:22:55.135045 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:22:55.135045 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:22:55.135282 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:22:55.135371 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 02:22:55.135697 (+ 326us) server_negotiation.cc:299] Negotiation successful
0809 02:22:55.135930 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79,"thread_start_us":53,"threads_started":1}
I20260809 02:22:55.136085 29642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:55.125528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:37815 (local address 127.11.93.129:46069)
0809 02:22:55.126520 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:55.126531 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:22:55.126592 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:22:55.127255 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:22:55.127256 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:22:55.127434 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:22:55.127488 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:55.127490 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:55.128562 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:55.128563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:55.129086 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:22:55.129088 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:22:55.129710 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:22:55.129711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:22:55.129806 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:22:55.130420 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:22:55.130428 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:22:55.131975 (+ 1547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:22:55.134242 (+ 2267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:22:55.134249 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:22:55.134251 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:22:55.134558 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:22:55.134813 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:22:55.134814 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:22:55.134815 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:22:55.134939 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:22:55.135365 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:22:55.135371 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:22:55.135498 (+ 127us) client_negotiation.cc:769] Sending connection context
0809 02:22:55.135635 (+ 137us) client_negotiation.cc:240] Negotiation successful
0809 02:22:55.135987 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":977,"thread_start_us":56,"threads_started":1}
W20260809 02:22:55.137111 29221 leader_election.cc:341] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 45740c812bfb44fb8e8694792410fe99 (127.11.93.131:37815): Not found: Tablet not found: 0e31c13216cf4d2bbab4fd6ad94bafce
W20260809 02:22:55.137253 29222 leader_election.cc:341] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ec3ac562aaa6489d95e48d18a67fa409 (127.11.93.130:36587): Not found: Tablet not found: 0e31c13216cf4d2bbab4fd6ad94bafce
I20260809 02:22:55.137305 29222 leader_election.cc:302] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dda693cf80f9444ba9e655c1b3fcd95f; no voters: 45740c812bfb44fb8e8694792410fe99, ec3ac562aaa6489d95e48d18a67fa409
I20260809 02:22:55.137391 29641 raft_consensus.cc:2726] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:22:55.716929 29645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:55.716716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.129:55337)
0809 02:22:55.716839 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:55.716878 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":62,"threads_started":1}
I20260809 02:22:55.808348 29646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:55.808094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.130:45473)
0809 02:22:55.808267 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:55.808307 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":59,"threads_started":1}
I20260809 02:22:55.954792 29647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:55.954557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.131:35665)
0809 02:22:55.954706 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:55.954751 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":62,"threads_started":1}
I20260809 02:22:56.717679 29648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:56.717448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.129:33241)
0809 02:22:56.717589 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:56.717629 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":64,"threads_started":1}
I20260809 02:22:56.809048 29649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:56.808825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.130:37387)
0809 02:22:56.808971 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:56.809009 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":64,"threads_started":1}
I20260809 02:22:56.955715 29651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:56.955440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.131:38753)
0809 02:22:56.955615 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:56.955655 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":95,"threads_started":1}
I20260809 02:22:57.003484 29652 raft_consensus.cc:482] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:22:57.003619 29652 raft_consensus.cc:504] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } } peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } }
I20260809 02:22:57.003829 29652 leader_election.cc:288] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec3ac562aaa6489d95e48d18a67fa409 (127.11.93.130:36587), 45740c812bfb44fb8e8694792410fe99 (127.11.93.131:37815)
W20260809 02:22:57.004307 29222 leader_election.cc:341] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ec3ac562aaa6489d95e48d18a67fa409 (127.11.93.130:36587): Not found: Tablet not found: 0e31c13216cf4d2bbab4fd6ad94bafce
W20260809 02:22:57.004470 29221 leader_election.cc:341] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 45740c812bfb44fb8e8694792410fe99 (127.11.93.131:37815): Not found: Tablet not found: 0e31c13216cf4d2bbab4fd6ad94bafce
I20260809 02:22:57.004550 29221 leader_election.cc:302] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dda693cf80f9444ba9e655c1b3fcd95f; no voters: 45740c812bfb44fb8e8694792410fe99, ec3ac562aaa6489d95e48d18a67fa409
I20260809 02:22:57.004662 29652 raft_consensus.cc:2726] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:22:57.718516 29653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:57.718258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.129:55813)
0809 02:22:57.718411 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:57.718468 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":72,"threads_started":1}
I20260809 02:22:57.809849 29654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:57.809625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.130:41423)
0809 02:22:57.809749 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:57.809795 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":61,"threads_started":1}
I20260809 02:22:57.956532 29655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:57.956254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.131:42603)
0809 02:22:57.956444 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:57.956487 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":88,"threads_started":1}
I20260809 02:22:58.719482 29656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:58.719267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.129:42803)
0809 02:22:58.719396 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:58.719435 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":65,"threads_started":1}
I20260809 02:22:58.810472 29657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:58.810271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.130:51711)
0809 02:22:58.810391 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:58.810429 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":58,"threads_started":1}
I20260809 02:22:58.957269 29658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:58.957043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.131:43143)
0809 02:22:58.957181 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:58.957216 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":80,"threads_started":1}
I20260809 02:22:59.720228 29659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:59.719997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.129:58193)
0809 02:22:59.720137 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:59.720180 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":65,"threads_started":1}
I20260809 02:22:59.811218 29660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:59.810950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.130:49039)
0809 02:22:59.811118 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:59.811163 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":116,"threads_started":1}
I20260809 02:22:59.958019 29661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:22:59.957766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.131:55687)
0809 02:22:59.957928 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 02:22:59.957973 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":95,"threads_started":1}
I20260809 02:23:00.046478 29662 raft_consensus.cc:482] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:23:00.046582 29662 raft_consensus.cc:504] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } } peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } }
I20260809 02:23:00.046811 29662 leader_election.cc:288] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec3ac562aaa6489d95e48d18a67fa409 (127.11.93.130:36587), 45740c812bfb44fb8e8694792410fe99 (127.11.93.131:37815)
W20260809 02:23:00.047317 29221 leader_election.cc:341] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 45740c812bfb44fb8e8694792410fe99 (127.11.93.131:37815): Not found: Tablet not found: 0e31c13216cf4d2bbab4fd6ad94bafce
W20260809 02:23:00.047420 29222 leader_election.cc:341] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ec3ac562aaa6489d95e48d18a67fa409 (127.11.93.130:36587): Not found: Tablet not found: 0e31c13216cf4d2bbab4fd6ad94bafce
I20260809 02:23:00.047523 29222 leader_election.cc:302] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dda693cf80f9444ba9e655c1b3fcd95f; no voters: 45740c812bfb44fb8e8694792410fe99, ec3ac562aaa6489d95e48d18a67fa409
I20260809 02:23:00.047624 29662 raft_consensus.cc:2726] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:23:00.720948 29663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:00.720729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.129:48483)
0809 02:23:00.720866 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:00.720901 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":80,"threads_started":1}
I20260809 02:23:00.811926 29665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:00.811697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.130:47215)
0809 02:23:00.811842 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:00.811883 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":81,"threads_started":1}
I20260809 02:23:00.958808 29666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:00.958585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.131:47315)
0809 02:23:00.958718 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:00.958763 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":62,"threads_started":1}
I20260809 02:23:01.721679 29667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:01.721430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.129:37357)
0809 02:23:01.721591 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:01.721632 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":70,"threads_started":1}
I20260809 02:23:01.812636 29668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:01.812399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.130:54765)
0809 02:23:01.812553 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:01.812592 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":90,"threads_started":1}
I20260809 02:23:01.959549 29669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:01.959326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.131:51119)
0809 02:23:01.959468 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:01.959507 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":77,"threads_started":1}
I20260809 02:23:02.722393 29670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:02.722147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.129:44757)
0809 02:23:02.722305 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:02.722345 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":68,"threads_started":1}
I20260809 02:23:02.813421 29671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:02.813156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.130:56497)
0809 02:23:02.813341 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:02.813375 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":132,"threads_started":1}
I20260809 02:23:02.960330 29672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:02.960073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.131:56371)
0809 02:23:02.960236 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:02.960282 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":63,"threads_started":1}
I20260809 02:23:03.476931 29673 raft_consensus.cc:482] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:23:03.477072 29673 raft_consensus.cc:504] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } } peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } }
I20260809 02:23:03.477380 29673 leader_election.cc:288] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec3ac562aaa6489d95e48d18a67fa409 (127.11.93.130:36587), 45740c812bfb44fb8e8694792410fe99 (127.11.93.131:37815)
W20260809 02:23:03.477877 29221 leader_election.cc:341] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 45740c812bfb44fb8e8694792410fe99 (127.11.93.131:37815): Not found: Tablet not found: 0e31c13216cf4d2bbab4fd6ad94bafce
W20260809 02:23:03.477963 29222 leader_election.cc:341] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ec3ac562aaa6489d95e48d18a67fa409 (127.11.93.130:36587): Not found: Tablet not found: 0e31c13216cf4d2bbab4fd6ad94bafce
I20260809 02:23:03.478012 29222 leader_election.cc:302] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dda693cf80f9444ba9e655c1b3fcd95f; no voters: 45740c812bfb44fb8e8694792410fe99, ec3ac562aaa6489d95e48d18a67fa409
I20260809 02:23:03.478088 29673 raft_consensus.cc:2726] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:23:03.723285 29674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:03.722954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.129:41383)
0809 02:23:03.723157 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:03.723202 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":141,"threads_started":1}
I20260809 02:23:03.814255 29675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:03.813968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.130:50983)
0809 02:23:03.814135 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:03.814179 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":101,"threads_started":1}
I20260809 02:23:03.961179 29676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:03.960935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.131:36665)
0809 02:23:03.961075 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:03.961117 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":62,"threads_started":1}
I20260809 02:23:04.724088 29677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:04.723865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.129:46253)
0809 02:23:04.723999 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:04.724039 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":64,"threads_started":1}
I20260809 02:23:04.815044 29678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:04.814768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.130:52187)
0809 02:23:04.814924 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:04.814967 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":85,"threads_started":1}
I20260809 02:23:04.962020 29679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:04.961716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.131:51195)
0809 02:23:04.961900 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:04.961945 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":83,"threads_started":1}
I20260809 02:23:05.725000 29680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:05.724747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.129:58141)
0809 02:23:05.724907 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:05.724951 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":95,"threads_started":1}
I20260809 02:23:05.815781 29681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:05.815543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.130:44269)
0809 02:23:05.815694 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:05.815734 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":79,"threads_started":1}
I20260809 02:23:05.962817 29682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:05.962583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.131:45431)
0809 02:23:05.962733 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:05.962771 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":79,"threads_started":1}
I20260809 02:23:06.725854 29683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:06.725579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.129:51821)
0809 02:23:06.725756 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:06.725806 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":81,"threads_started":1}
I20260809 02:23:06.816576 29684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:06.816290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.130:39389)
0809 02:23:06.816477 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:06.816522 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":105,"threads_started":1}
I20260809 02:23:06.963593 29685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:06.963324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.131:46503)
0809 02:23:06.963491 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:06.963536 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":80,"threads_started":1}
I20260809 02:23:07.726742 29686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:07.726485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.129:38393)
0809 02:23:07.726642 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:07.726689 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":79,"threads_started":1}
I20260809 02:23:07.817509 29687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:07.817255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.130:53771)
0809 02:23:07.817416 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:07.817458 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":87,"threads_started":1}
I20260809 02:23:07.964496 29688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:07.964239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.131:34399)
0809 02:23:07.964396 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:07.964439 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":82,"threads_started":1}
I20260809 02:23:08.727604 29689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:08.727335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.129:36605)
0809 02:23:08.727509 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:08.727555 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":76,"threads_started":1}
I20260809 02:23:08.806003 29690 raft_consensus.cc:482] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:23:08.806121 29690 raft_consensus.cc:504] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3ac562aaa6489d95e48d18a67fa409" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36587 } } peers { permanent_uuid: "45740c812bfb44fb8e8694792410fe99" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 37815 } } peers { permanent_uuid: "dda693cf80f9444ba9e655c1b3fcd95f" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46173 } }
I20260809 02:23:08.806385 29690 leader_election.cc:288] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec3ac562aaa6489d95e48d18a67fa409 (127.11.93.130:36587), 45740c812bfb44fb8e8694792410fe99 (127.11.93.131:37815)
W20260809 02:23:08.806743 29222 leader_election.cc:341] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ec3ac562aaa6489d95e48d18a67fa409 (127.11.93.130:36587): Not found: Tablet not found: 0e31c13216cf4d2bbab4fd6ad94bafce
W20260809 02:23:08.806819 29221 leader_election.cc:341] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 45740c812bfb44fb8e8694792410fe99 (127.11.93.131:37815): Not found: Tablet not found: 0e31c13216cf4d2bbab4fd6ad94bafce
I20260809 02:23:08.806907 29221 leader_election.cc:302] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dda693cf80f9444ba9e655c1b3fcd95f; no voters: 45740c812bfb44fb8e8694792410fe99, ec3ac562aaa6489d95e48d18a67fa409
I20260809 02:23:08.807035 29690 raft_consensus.cc:2726] T 0e31c13216cf4d2bbab4fd6ad94bafce P dda693cf80f9444ba9e655c1b3fcd95f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:23:08.818447 29691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:08.818230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.130:59717)
0809 02:23:08.818364 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:08.818401 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":60,"threads_started":1}
I20260809 02:23:08.963476 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 29168
I20260809 02:23:08.965369 29693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:08.965101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40059 (local address 127.11.93.131:47989)
0809 02:23:08.965260 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:08.965303 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.190:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":67,"threads_started":1}
I20260809 02:23:08.971331 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 29351
I20260809 02:23:08.977583 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 29494
2026-08-09T02:23:08Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58713 ms)
[----------] 30 tests from SecurityITest (237224 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:09 dist-test-slave-w206 krb5kdc[29696](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:09 dist-test-slave-w206 krb5kdc[29696](info): set up 2 sockets
Aug 09 02:23:09 dist-test-slave-w206 krb5kdc[29696](info): commencing operation
krb5kdc: starting...
W20260809 02:23:10.062860 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:23:10 dist-test-slave-w206 krb5kdc[29696](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:23:10.190704 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:40195
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:46455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:40195
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:10.279374 29710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:10.279582 29710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:10.279604 29710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:10.280766 29710 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:10.280808 29710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:10.280822 29710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:10.280835 29710 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:10.280848 29710 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:10.282330 29710 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:46455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:40195
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:40195
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29710
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:10.282583 29710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:10.282812 29710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:10.288618 29717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:10.288637 29719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:10.288654 29710 server_base.cc:1034] running on GCE node
W20260809 02:23:10.288610 29716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:10.289070 29710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:10.289359 29710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:10.290531 29710 hybrid_clock.cc:648] HybridClock initialized: now 1786242190290518 us; error 33 us; skew 500 ppm
Aug 09 02:23:10 dist-test-slave-w206 krb5kdc[29696](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242190, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:10.293274 29710 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:23:10.293788 29710 webserver.cc:460] Webserver started at http://127.11.93.190:40169/ using document root <none> and password file <none>
I20260809 02:23:10.294039 29710 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:10.294111 29710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:10.294262 29710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:10.295423 29710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "f45ced0c54f9465bbe8250108599440f"
format_stamp: "Formatted at 2026-08-09 02:23:10 on dist-test-slave-w206"
server_key: "de572a60b505420d5b0a4343afc4ff43"
server_key_iv: "4f68a402b3855d6eb8c95cae74339493"
server_key_version: "encryptionkey@0"
I20260809 02:23:10.295821 29710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "f45ced0c54f9465bbe8250108599440f"
format_stamp: "Formatted at 2026-08-09 02:23:10 on dist-test-slave-w206"
server_key: "de572a60b505420d5b0a4343afc4ff43"
server_key_iv: "4f68a402b3855d6eb8c95cae74339493"
server_key_version: "encryptionkey@0"
I20260809 02:23:10.297257 29710 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:23:10.298148 29726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:10.298494 29710 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:10.298626 29710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "f45ced0c54f9465bbe8250108599440f"
format_stamp: "Formatted at 2026-08-09 02:23:10 on dist-test-slave-w206"
server_key: "de572a60b505420d5b0a4343afc4ff43"
server_key_iv: "4f68a402b3855d6eb8c95cae74339493"
server_key_version: "encryptionkey@0"
I20260809 02:23:10.298717 29710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:10.307338 29710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:10.309118 29710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:10.309291 29710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:10.313663 29710 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:40195
I20260809 02:23:10.313697 29780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:40195 every 8 connection(s)
I20260809 02:23:10.314062 29710 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:10.314913 29781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:10.316111 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 29710
I20260809 02:23:10.316227 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:10.316437 11638 external_mini_cluster.cc:1428] Setting key f47d004a9f2f68277120696985eed569
I20260809 02:23:10.317742 29781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f: Bootstrap starting.
I20260809 02:23:10.318523 29781 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:10.318842 29781 log.cc:824] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:10.319587 29781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f: No bootstrap required, opened a new log
I20260809 02:23:10.322000 29781 raft_consensus.cc:348] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f45ced0c54f9465bbe8250108599440f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40195 } }
I20260809 02:23:10.322237 29781 raft_consensus.cc:374] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:10.322281 29781 raft_consensus.cc:729] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f45ced0c54f9465bbe8250108599440f, State: Initialized, Role: FOLLOWER
I20260809 02:23:10.322419 29781 consensus_queue.cc:260] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f45ced0c54f9465bbe8250108599440f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40195 } }
I20260809 02:23:10.322528 29781 raft_consensus.cc:388] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:10.322574 29781 raft_consensus.cc:482] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:10.322619 29781 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:10.323483 29781 raft_consensus.cc:504] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f45ced0c54f9465bbe8250108599440f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40195 } }
I20260809 02:23:10.323578 29781 leader_election.cc:302] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f45ced0c54f9465bbe8250108599440f; no voters:
I20260809 02:23:10.323753 29781 leader_election.cc:288] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:10.323794 29786 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:10.323917 29786 raft_consensus.cc:686] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f [term 1 LEADER]: Becoming Leader. State: Replica: f45ced0c54f9465bbe8250108599440f, State: Running, Role: LEADER
Aug 09 02:23:10 dist-test-slave-w206 krb5kdc[29696](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:23:10.324059 29786 consensus_queue.cc:237] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f45ced0c54f9465bbe8250108599440f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40195 } }
I20260809 02:23:10.324551 29788 sys_catalog.cc:455] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f [sys.catalog]: SysCatalogTable state changed. Reason: New leader f45ced0c54f9465bbe8250108599440f. Latest consensus state: current_term: 1 leader_uuid: "f45ced0c54f9465bbe8250108599440f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f45ced0c54f9465bbe8250108599440f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40195 } } }
I20260809 02:23:10.324584 29787 sys_catalog.cc:455] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f45ced0c54f9465bbe8250108599440f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f45ced0c54f9465bbe8250108599440f" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 40195 } } }
I20260809 02:23:10.324922 29787 sys_catalog.cc:458] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:10.324059 29781 sys_catalog.cc:564] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:10.324909 29788 sys_catalog.cc:458] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:10.325649 29790 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:10.326253 29790 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:10.328559 29790 catalog_manager.cc:1347] Generated new cluster ID: 5196e94d658a44adb6be5a1382efe8c6
I20260809 02:23:10.328634 29790 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:10.329231 29784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:10.316991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55382 (local address 127.11.93.190:40195)
0809 02:23:10.317163 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:10.317225 (+ 62us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:10.317252 (+ 27us) server_negotiation.cc:407] Connection header received
0809 02:23:10.317654 (+ 402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:10.317660 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:10.317705 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:10.317845 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:10.318669 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.319897 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.321021 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.321443 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.321538 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:10.324634 (+ 3096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:10.324639 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:10.324640 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:10.324676 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:10.327227 (+ 2551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:10.327715 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:10.327719 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:10.327720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:10.327830 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:10.328069 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:10.328070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:10.328071 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:10.328387 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:10.328510 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:10.328894 (+ 384us) server_negotiation.cc:299] Negotiation successful
0809 02:23:10.329037 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":86,"threads_started":1}
I20260809 02:23:10.354611 29790 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:10.355345 29790 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:10.364218 29790 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f: Generated new TSK 0
I20260809 02:23:10.364444 29790 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.93.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
I20260809 02:23:10.398097 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:40195
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:46455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:10.480417 29807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:10.480611 29807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:10.480635 29807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:10.481777 29807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:10.481822 29807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:10.481848 29807 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:23:10.483376 29807 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:46455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:40195
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:10.483621 29807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:10.483876 29807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:10.489073 29815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:10.489106 29812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:10.489367 29807 server_base.cc:1034] running on GCE node
W20260809 02:23:10.489078 29813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:10.489665 29807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:10.489934 29807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:10.491094 29807 hybrid_clock.cc:648] HybridClock initialized: now 1786242190491083 us; error 37 us; skew 500 ppm
Aug 09 02:23:10 dist-test-slave-w206 krb5kdc[29696](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242190, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:10.493844 29807 init.cc:377] Logged in from keytab as kudu/127.11.93.129@KRBTEST.COM (short username kudu)
I20260809 02:23:10.494323 29807 webserver.cc:460] Webserver started at http://127.11.93.129:40055/ using document root <none> and password file <none>
I20260809 02:23:10.494560 29807 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:10.494629 29807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:10.494788 29807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:10.495995 29807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "5de6ec4fde5441bbb8b990352ac5d35a"
format_stamp: "Formatted at 2026-08-09 02:23:10 on dist-test-slave-w206"
server_key: "1b6f21b641ba321e79437fccbc65df6d"
server_key_iv: "c88f881b5a7d47d89941907a12b7d463"
server_key_version: "encryptionkey@0"
I20260809 02:23:10.496369 29807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "5de6ec4fde5441bbb8b990352ac5d35a"
format_stamp: "Formatted at 2026-08-09 02:23:10 on dist-test-slave-w206"
server_key: "1b6f21b641ba321e79437fccbc65df6d"
server_key_iv: "c88f881b5a7d47d89941907a12b7d463"
server_key_version: "encryptionkey@0"
I20260809 02:23:10.497715 29807 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:23:10.498514 29823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:10.498724 29807 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:10.498832 29807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "5de6ec4fde5441bbb8b990352ac5d35a"
format_stamp: "Formatted at 2026-08-09 02:23:10 on dist-test-slave-w206"
server_key: "1b6f21b641ba321e79437fccbc65df6d"
server_key_iv: "c88f881b5a7d47d89941907a12b7d463"
server_key_version: "encryptionkey@0"
I20260809 02:23:10.498911 29807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:10.506428 29807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:10.508811 29807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:10.508988 29807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:10.509227 29807 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:10.509538 29807 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:10.509593 29807 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:10.509634 29807 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:10.509665 29807 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:10.515631 29807 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:35277
I20260809 02:23:10.515679 29944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:35277 every 8 connection(s)
I20260809 02:23:10.516053 29807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
Aug 09 02:23:10 dist-test-slave-w206 krb5kdc[29696](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242190, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:23:10.523699 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 29807
I20260809 02:23:10.523818 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:23:10.524073 11638 external_mini_cluster.cc:1428] Setting key 31450b9c6b901834536955e6964ff547
I20260809 02:23:10.526295 29784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:10.516839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:54179 (local address 127.11.93.190:40195)
0809 02:23:10.516899 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:10.516901 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:10.517103 (+ 202us) server_negotiation.cc:407] Connection header received
0809 02:23:10.517595 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:10.517596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:10.517606 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:10.517663 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:10.518619 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.519207 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.520210 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.520457 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.520513 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:10.522787 (+ 2274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:10.522788 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:10.522788 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:10.522795 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:10.524568 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:10.525096 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:10.525097 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:10.525097 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:10.525210 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:10.525481 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:10.525482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:10.525482 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:10.525653 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:10.525733 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:10.526102 (+ 369us) server_negotiation.cc:299] Negotiation successful
0809 02:23:10.526204 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 02:23:10.526477 29947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:10.516814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40195 (local address 127.11.93.129:54179)
0809 02:23:10.516976 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:10.517011 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:10.517511 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:10.517741 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:10.517744 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:10.518309 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:10.518521 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:10.518525 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.519290 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.519291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:10.520126 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:10.520128 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.520535 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.520536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:10.520633 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:10.521182 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:10.521190 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:10.522688 (+ 1498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:10.524650 (+ 1962us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:10.524659 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:10.524661 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:10.525020 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:10.525278 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:10.525279 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:10.525279 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:10.525402 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:10.525738 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:10.525745 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:10.525924 (+ 179us) client_negotiation.cc:769] Sending connection context
0809 02:23:10.526050 (+ 126us) client_negotiation.cc:240] Negotiation successful
0809 02:23:10.526215 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":95,"threads_started":1}
I20260809 02:23:10.527336 29945 heartbeater.cc:347] Connected to a master server at 127.11.93.190:40195
I20260809 02:23:10.527453 29945 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:10.527652 29945 heartbeater.cc:511] Master 127.11.93.190:40195 requested a full tablet report, sending...
I20260809 02:23:10.528249 29743 ts_manager.cc:194] Registered new tserver with Master: 5de6ec4fde5441bbb8b990352ac5d35a (127.11.93.129:35277)
I20260809 02:23:10.528879 29743 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:54179
WARNING: no policy specified for kudu/127.11.93.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
I20260809 02:23:10.552006 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:40195
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:46455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:10.634894 29950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:10.635114 29950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:10.635138 29950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:10.636309 29950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:10.636354 29950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:10.636380 29950 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:23:10.637924 29950 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:46455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:40195
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:10.638175 29950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:10.638411 29950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:10.643837 29959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:10.643808 29956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:10.643810 29957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:10.644076 29950 server_base.cc:1034] running on GCE node
I20260809 02:23:10.644263 29950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:10.644459 29950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:10.645608 29950 hybrid_clock.cc:648] HybridClock initialized: now 1786242190645598 us; error 30 us; skew 500 ppm
Aug 09 02:23:10 dist-test-slave-w206 krb5kdc[29696](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242190, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:10.648298 29950 init.cc:377] Logged in from keytab as kudu/127.11.93.130@KRBTEST.COM (short username kudu)
I20260809 02:23:10.648770 29950 webserver.cc:460] Webserver started at http://127.11.93.130:38357/ using document root <none> and password file <none>
I20260809 02:23:10.648960 29950 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:10.649001 29950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:10.649091 29950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:10.650065 29950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "fd45efe52ca74dafb9e438691dd10006"
format_stamp: "Formatted at 2026-08-09 02:23:10 on dist-test-slave-w206"
server_key: "73059156bd88d03f9f4c8b179ac89a8e"
server_key_iv: "f48832bc6a030407724a63f3c8744a0b"
server_key_version: "encryptionkey@0"
I20260809 02:23:10.650375 29950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "fd45efe52ca74dafb9e438691dd10006"
format_stamp: "Formatted at 2026-08-09 02:23:10 on dist-test-slave-w206"
server_key: "73059156bd88d03f9f4c8b179ac89a8e"
server_key_iv: "f48832bc6a030407724a63f3c8744a0b"
server_key_version: "encryptionkey@0"
I20260809 02:23:10.651750 29950 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:23:10.652491 29966 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:10.652680 29950 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:10.652763 29950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "fd45efe52ca74dafb9e438691dd10006"
format_stamp: "Formatted at 2026-08-09 02:23:10 on dist-test-slave-w206"
server_key: "73059156bd88d03f9f4c8b179ac89a8e"
server_key_iv: "f48832bc6a030407724a63f3c8744a0b"
server_key_version: "encryptionkey@0"
I20260809 02:23:10.652817 29950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:10.666733 29950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:10.669092 29950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:10.669207 29950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:10.669399 29950 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:10.669723 29950 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:10.669759 29950 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:10.669780 29950 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:10.669828 29950 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:10.675572 29950 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:41845
I20260809 02:23:10.675679 30085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:41845 every 8 connection(s)
I20260809 02:23:10.675976 29950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:23:10.677567 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 29950
I20260809 02:23:10.677718 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:23:10.677971 11638 external_mini_cluster.cc:1428] Setting key 592fbb7c97a2fa15b566a13db0e2b0a4
Aug 09 02:23:10 dist-test-slave-w206 krb5kdc[29696](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242190, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:23:10.687356 29784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:10.676818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:40519 (local address 127.11.93.190:40195)
0809 02:23:10.676912 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:10.676914 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:10.677077 (+ 163us) server_negotiation.cc:407] Connection header received
0809 02:23:10.677809 (+ 732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:10.677811 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:10.677823 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:10.677892 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:10.679284 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.679781 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.681176 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.681507 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.681584 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:10.683981 (+ 2397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:10.683982 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:10.683982 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:10.683992 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:10.685816 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:10.686253 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:10.686254 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:10.686255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:10.686317 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:10.686582 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:10.686583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:10.686583 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:10.686725 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:10.686806 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:10.687125 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 02:23:10.687219 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 02:23:10.687382 30088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:10.676719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40195 (local address 127.11.93.130:40519)
0809 02:23:10.676894 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:10.676967 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:10.677615 (+ 648us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:10.677994 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:10.677999 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:10.678832 (+ 833us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:10.679190 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:10.679197 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.679879 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.679881 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:10.681082 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:10.681085 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.681605 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.681606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:10.681718 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:10.682289 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:10.682297 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:10.683880 (+ 1583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:10.685932 (+ 2052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:10.685939 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:10.685941 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:10.686169 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:10.686397 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:10.686398 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:10.686398 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:10.686511 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:10.686798 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:10.686802 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:10.686929 (+ 127us) client_negotiation.cc:769] Sending connection context
0809 02:23:10.687081 (+ 152us) client_negotiation.cc:240] Negotiation successful
0809 02:23:10.687203 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":70,"threads_started":1}
WARNING: no policy specified for kudu/127.11.93.131@KRBTEST.COM; defaulting to no policy
I20260809 02:23:10.688058 30086 heartbeater.cc:347] Connected to a master server at 127.11.93.190:40195
I20260809 02:23:10.688175 30086 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:10.688334 30086 heartbeater.cc:511] Master 127.11.93.190:40195 requested a full tablet report, sending...
I20260809 02:23:10.688714 29743 ts_manager.cc:194] Registered new tserver with Master: fd45efe52ca74dafb9e438691dd10006 (127.11.93.130:41845)
I20260809 02:23:10.689217 29743 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:40519
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
I20260809 02:23:10.706758 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:40195
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:46455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:10.790827 30091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:10.791055 30091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:10.791080 30091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:10.792263 30091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:10.792306 30091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:10.792333 30091 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:23:10.793774 30091 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:46455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:40195
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30091
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:10.794013 30091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:10.794260 30091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:10.799578 30098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:10.799594 30100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:10.799594 30097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:10.799929 30091 server_base.cc:1034] running on GCE node
I20260809 02:23:10.800104 30091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:10.800370 30091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:10.801515 30091 hybrid_clock.cc:648] HybridClock initialized: now 1786242190801503 us; error 26 us; skew 500 ppm
Aug 09 02:23:10 dist-test-slave-w206 krb5kdc[29696](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242190, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:10.804359 30091 init.cc:377] Logged in from keytab as kudu/127.11.93.131@KRBTEST.COM (short username kudu)
I20260809 02:23:10.804796 30091 webserver.cc:460] Webserver started at http://127.11.93.131:34657/ using document root <none> and password file <none>
I20260809 02:23:10.805025 30091 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:10.805070 30091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:10.805197 30091 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:10.806252 30091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "542f6732ffc242e2b47704195dac29f8"
format_stamp: "Formatted at 2026-08-09 02:23:10 on dist-test-slave-w206"
server_key: "ff8c0dec6d059d28e1cd0226b3f7687c"
server_key_iv: "ef0844b0393483d06339f1b2ef1fe439"
server_key_version: "encryptionkey@0"
I20260809 02:23:10.806609 30091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "542f6732ffc242e2b47704195dac29f8"
format_stamp: "Formatted at 2026-08-09 02:23:10 on dist-test-slave-w206"
server_key: "ff8c0dec6d059d28e1cd0226b3f7687c"
server_key_iv: "ef0844b0393483d06339f1b2ef1fe439"
server_key_version: "encryptionkey@0"
I20260809 02:23:10.808058 30091 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:23:10.808805 30108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:10.809019 30091 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:10.809092 30091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "542f6732ffc242e2b47704195dac29f8"
format_stamp: "Formatted at 2026-08-09 02:23:10 on dist-test-slave-w206"
server_key: "ff8c0dec6d059d28e1cd0226b3f7687c"
server_key_iv: "ef0844b0393483d06339f1b2ef1fe439"
server_key_version: "encryptionkey@0"
I20260809 02:23:10.809199 30091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:10.824316 30091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:10.827242 30091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:10.827421 30091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:10.827702 30091 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:10.828028 30091 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:10.828086 30091 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:10.828130 30091 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:10.828163 30091 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:10.834167 30091 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:39733
I20260809 02:23:10.834211 30224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:39733 every 8 connection(s)
I20260809 02:23:10.834537 30091 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
Aug 09 02:23:10 dist-test-slave-w206 krb5kdc[29696](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242190, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:23:10.842473 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 30091
I20260809 02:23:10.842588 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:23:10.842783 11638 external_mini_cluster.cc:1428] Setting key d5a627c6472fb702cbe7280c99dd4256
I20260809 02:23:10.844195 29784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:10.835248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:57153 (local address 127.11.93.190:40195)
0809 02:23:10.835338 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:10.835340 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:10.835493 (+ 153us) server_negotiation.cc:407] Connection header received
0809 02:23:10.836032 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:10.836033 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:10.836046 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:10.836111 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:10.837097 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.837599 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.838651 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.838851 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.838941 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:10.841172 (+ 2231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:10.841173 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:10.841174 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:10.841182 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:10.842583 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:10.843123 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:10.843124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:10.843124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:10.843190 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:10.843551 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:10.843551 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:10.843552 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:10.843682 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:10.843770 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:10.844063 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 02:23:10.844130 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 02:23:10.844342 30227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:10.835204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:40195 (local address 127.11.93.131:57153)
0809 02:23:10.835350 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:10.835396 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:10.835923 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:10.836179 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:10.836183 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:10.836792 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:10.836986 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:10.836991 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.837703 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.837704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:10.838540 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:10.838543 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.838968 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.838989 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:10.839115 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:10.839578 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:10.839585 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:10.841049 (+ 1464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:10.842676 (+ 1627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:10.842683 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:10.842686 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:10.843046 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:10.843311 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:10.843312 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:10.843312 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:10.843481 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:10.843771 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:10.843777 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:10.843940 (+ 163us) client_negotiation.cc:769] Sending connection context
0809 02:23:10.844026 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 02:23:10.844147 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":67,"threads_started":1}
I20260809 02:23:10.844800 30225 heartbeater.cc:347] Connected to a master server at 127.11.93.190:40195
I20260809 02:23:10.844920 30225 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:10.845095 30225 heartbeater.cc:511] Master 127.11.93.190:40195 requested a full tablet report, sending...
I20260809 02:23:10.845535 29743 ts_manager.cc:194] Registered new tserver with Master: 542f6732ffc242e2b47704195dac29f8 (127.11.93.131:39733)
I20260809 02:23:10.846024 29743 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:57153
I20260809 02:23:10.854846 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:23:10.862689 29784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:10.856389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55394 (local address 127.11.93.190:40195)
0809 02:23:10.856442 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:10.856444 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:10.856579 (+ 135us) server_negotiation.cc:407] Connection header received
0809 02:23:10.856657 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:10.856658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:10.856669 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:10.856727 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:10.857307 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.857790 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.858543 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.858737 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.858810 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:10.860118 (+ 1308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:10.860119 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:10.860120 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:10.860127 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:10.861364 (+ 1237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:10.861772 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:10.861773 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:10.861774 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:10.861837 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:10.862046 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:10.862047 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:10.862047 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:10.862250 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:10.862374 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:10.862486 (+ 112us) server_negotiation.cc:299] Negotiation successful
0809 02:23:10.862568 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 02:23:10.864223 29743 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55394:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:23:10.865885 29743 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:23:10.872507 30241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:10.868398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:41845 (local address 127.0.0.1:58696)
0809 02:23:10.868515 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:10.868523 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:10.868561 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:10.869119 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:10.869120 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:10.869121 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:10.869167 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:10.869169 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.870492 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.870493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:10.871440 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:10.871442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.872189 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.872190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:10.872269 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:10.872284 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 02:23:10.872356 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 02:23:10.872413 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"mutex_wait_us":11,"thread_start_us":65,"threads_started":1}
I20260809 02:23:10.872615 30240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:10.868252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35658 (local address 127.11.93.131:39733)
0809 02:23:10.868936 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:10.868940 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:10.868949 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:23:10.868992 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:10.868994 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:10.869009 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:10.869244 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:10.869330 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.870022 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.871499 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.872248 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.872337 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:10.872400 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:10.872480 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 02:23:10.872530 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":647,"thread_start_us":82,"threads_started":1}
I20260809 02:23:10.872865 30243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:10.868714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58696 (local address 127.11.93.130:41845)
0809 02:23:10.868872 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:10.868876 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:10.868889 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:23:10.868930 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:10.868933 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:10.868949 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:10.869041 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:10.869275 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.870372 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.871539 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.872092 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.872188 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:10.872255 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:10.872759 (+ 504us) server_negotiation.cc:299] Negotiation successful
0809 02:23:10.872798 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":84,"threads_started":1}
I20260809 02:23:10.872641 30238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:10.868174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:39733 (local address 127.0.0.1:35658)
0809 02:23:10.868322 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:10.868362 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:10.868426 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:10.869114 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:10.869115 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:10.869117 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:10.869166 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:10.869167 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.870136 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.870137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:10.871407 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:10.871410 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.872342 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.872344 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:10.872407 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:10.872410 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:23:10.872456 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 02:23:10.872491 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":63,"threads_started":1}
I20260809 02:23:10.873175 30242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:10.868554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38170 (local address 127.11.93.129:35277)
0809 02:23:10.868745 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:10.868749 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:10.868758 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:23:10.868812 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:10.868814 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:10.868829 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:10.869158 (+ 329us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:10.869235 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.870362 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.871610 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.872313 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.872906 (+ 593us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:10.872989 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:10.873019 (+ 30us) server_negotiation.cc:299] Negotiation successful
0809 02:23:10.873063 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":76,"threads_started":1}
I20260809 02:23:10.872843 30237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:10.868175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:35277 (local address 127.0.0.1:38170)
0809 02:23:10.868342 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:10.868367 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:10.868427 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:10.868993 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:10.868997 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:10.868999 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:10.869072 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:10.869074 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.870474 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.870475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:10.871544 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:10.871547 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.872409 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.872410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:10.872479 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:10.872484 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:23:10.872514 (+ 30us) client_negotiation.cc:240] Negotiation successful
0809 02:23:10.872552 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":93,"threads_started":1}
I20260809 02:23:10.873870 30017 tablet_service.cc:1467] Processing CreateTablet for tablet 5e6a968705e342fa93201a217b31e4ad (DEFAULT_TABLE table=test-table [id=27c8c861dc9c45ef8064d1d4410f0e2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:10.873950 30157 tablet_service.cc:1467] Processing CreateTablet for tablet 5e6a968705e342fa93201a217b31e4ad (DEFAULT_TABLE table=test-table [id=27c8c861dc9c45ef8064d1d4410f0e2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:10.874265 30017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e6a968705e342fa93201a217b31e4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:10.874182 29872 tablet_service.cc:1467] Processing CreateTablet for tablet 5e6a968705e342fa93201a217b31e4ad (DEFAULT_TABLE table=test-table [id=27c8c861dc9c45ef8064d1d4410f0e2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:10.874282 30157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e6a968705e342fa93201a217b31e4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:10.874485 29872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e6a968705e342fa93201a217b31e4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:10.877143 30244 tablet_bootstrap.cc:492] T 5e6a968705e342fa93201a217b31e4ad P 542f6732ffc242e2b47704195dac29f8: Bootstrap starting.
I20260809 02:23:10.877626 30246 tablet_bootstrap.cc:492] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a: Bootstrap starting.
I20260809 02:23:10.878118 30244 tablet_bootstrap.cc:654] T 5e6a968705e342fa93201a217b31e4ad P 542f6732ffc242e2b47704195dac29f8: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:10.878367 30246 tablet_bootstrap.cc:654] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:10.878805 30244 log.cc:824] T 5e6a968705e342fa93201a217b31e4ad P 542f6732ffc242e2b47704195dac29f8: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:10.879036 30246 log.cc:824] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:10.879139 30245 tablet_bootstrap.cc:492] T 5e6a968705e342fa93201a217b31e4ad P fd45efe52ca74dafb9e438691dd10006: Bootstrap starting.
I20260809 02:23:10.879698 30244 tablet_bootstrap.cc:492] T 5e6a968705e342fa93201a217b31e4ad P 542f6732ffc242e2b47704195dac29f8: No bootstrap required, opened a new log
I20260809 02:23:10.879793 30244 ts_tablet_manager.cc:1397] T 5e6a968705e342fa93201a217b31e4ad P 542f6732ffc242e2b47704195dac29f8: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260809 02:23:10.879868 30246 tablet_bootstrap.cc:492] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a: No bootstrap required, opened a new log
I20260809 02:23:10.879943 30245 tablet_bootstrap.cc:654] T 5e6a968705e342fa93201a217b31e4ad P fd45efe52ca74dafb9e438691dd10006: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:10.879961 30246 ts_tablet_manager.cc:1397] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260809 02:23:10.880509 30245 log.cc:824] T 5e6a968705e342fa93201a217b31e4ad P fd45efe52ca74dafb9e438691dd10006: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:10.881538 30245 tablet_bootstrap.cc:492] T 5e6a968705e342fa93201a217b31e4ad P fd45efe52ca74dafb9e438691dd10006: No bootstrap required, opened a new log
I20260809 02:23:10.881639 30245 ts_tablet_manager.cc:1397] T 5e6a968705e342fa93201a217b31e4ad P fd45efe52ca74dafb9e438691dd10006: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 02:23:10.881732 30244 raft_consensus.cc:348] T 5e6a968705e342fa93201a217b31e4ad P 542f6732ffc242e2b47704195dac29f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5de6ec4fde5441bbb8b990352ac5d35a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35277 } } peers { permanent_uuid: "fd45efe52ca74dafb9e438691dd10006" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 41845 } } peers { permanent_uuid: "542f6732ffc242e2b47704195dac29f8" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 39733 } }
I20260809 02:23:10.881916 30244 raft_consensus.cc:374] T 5e6a968705e342fa93201a217b31e4ad P 542f6732ffc242e2b47704195dac29f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:10.881964 30244 raft_consensus.cc:729] T 5e6a968705e342fa93201a217b31e4ad P 542f6732ffc242e2b47704195dac29f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 542f6732ffc242e2b47704195dac29f8, State: Initialized, Role: FOLLOWER
I20260809 02:23:10.882076 30244 consensus_queue.cc:260] T 5e6a968705e342fa93201a217b31e4ad P 542f6732ffc242e2b47704195dac29f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5de6ec4fde5441bbb8b990352ac5d35a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35277 } } peers { permanent_uuid: "fd45efe52ca74dafb9e438691dd10006" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 41845 } } peers { permanent_uuid: "542f6732ffc242e2b47704195dac29f8" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 39733 } }
I20260809 02:23:10.882124 30246 raft_consensus.cc:348] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5de6ec4fde5441bbb8b990352ac5d35a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35277 } } peers { permanent_uuid: "fd45efe52ca74dafb9e438691dd10006" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 41845 } } peers { permanent_uuid: "542f6732ffc242e2b47704195dac29f8" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 39733 } }
I20260809 02:23:10.882282 30246 raft_consensus.cc:374] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:10.882314 30246 raft_consensus.cc:729] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5de6ec4fde5441bbb8b990352ac5d35a, State: Initialized, Role: FOLLOWER
I20260809 02:23:10.882377 30225 heartbeater.cc:503] Master 127.11.93.190:40195 was elected leader, sending a full tablet report...
I20260809 02:23:10.882458 30246 consensus_queue.cc:260] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5de6ec4fde5441bbb8b990352ac5d35a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35277 } } peers { permanent_uuid: "fd45efe52ca74dafb9e438691dd10006" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 41845 } } peers { permanent_uuid: "542f6732ffc242e2b47704195dac29f8" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 39733 } }
I20260809 02:23:10.882732 30246 ts_tablet_manager.cc:1428] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 02:23:10.882367 30244 ts_tablet_manager.cc:1428] T 5e6a968705e342fa93201a217b31e4ad P 542f6732ffc242e2b47704195dac29f8: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 02:23:10.882921 29945 heartbeater.cc:503] Master 127.11.93.190:40195 was elected leader, sending a full tablet report...
I20260809 02:23:10.883724 30245 raft_consensus.cc:348] T 5e6a968705e342fa93201a217b31e4ad P fd45efe52ca74dafb9e438691dd10006 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5de6ec4fde5441bbb8b990352ac5d35a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35277 } } peers { permanent_uuid: "fd45efe52ca74dafb9e438691dd10006" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 41845 } } peers { permanent_uuid: "542f6732ffc242e2b47704195dac29f8" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 39733 } }
I20260809 02:23:10.883877 30245 raft_consensus.cc:374] T 5e6a968705e342fa93201a217b31e4ad P fd45efe52ca74dafb9e438691dd10006 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:10.883922 30245 raft_consensus.cc:729] T 5e6a968705e342fa93201a217b31e4ad P fd45efe52ca74dafb9e438691dd10006 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd45efe52ca74dafb9e438691dd10006, State: Initialized, Role: FOLLOWER
I20260809 02:23:10.884030 30245 consensus_queue.cc:260] T 5e6a968705e342fa93201a217b31e4ad P fd45efe52ca74dafb9e438691dd10006 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5de6ec4fde5441bbb8b990352ac5d35a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35277 } } peers { permanent_uuid: "fd45efe52ca74dafb9e438691dd10006" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 41845 } } peers { permanent_uuid: "542f6732ffc242e2b47704195dac29f8" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 39733 } }
I20260809 02:23:10.884289 30245 ts_tablet_manager.cc:1428] T 5e6a968705e342fa93201a217b31e4ad P fd45efe52ca74dafb9e438691dd10006: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 02:23:10.884353 30086 heartbeater.cc:503] Master 127.11.93.190:40195 was elected leader, sending a full tablet report...
I20260809 02:23:10.900756 30251 raft_consensus.cc:482] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:23:10.900878 30251 raft_consensus.cc:504] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5de6ec4fde5441bbb8b990352ac5d35a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35277 } } peers { permanent_uuid: "fd45efe52ca74dafb9e438691dd10006" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 41845 } } peers { permanent_uuid: "542f6732ffc242e2b47704195dac29f8" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 39733 } }
I20260809 02:23:10.901270 30251 leader_election.cc:288] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd45efe52ca74dafb9e438691dd10006 (127.11.93.130:41845), 542f6732ffc242e2b47704195dac29f8 (127.11.93.131:39733)
I20260809 02:23:10.905030 30240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:10.901539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:40815 (local address 127.11.93.131:39733)
0809 02:23:10.901603 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:10.901605 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:10.901768 (+ 163us) server_negotiation.cc:407] Connection header received
0809 02:23:10.901824 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:10.901825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:10.901836 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:10.901895 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:10.902081 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.902576 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.904071 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.904654 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.904739 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:10.904748 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:10.904920 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 02:23:10.904960 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 02:23:10.905030 30243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:10.901585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:43817 (local address 127.11.93.130:41845)
0809 02:23:10.901626 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:10.901629 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:10.901677 (+ 48us) server_negotiation.cc:407] Connection header received
0809 02:23:10.901728 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:10.901729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:10.901740 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:10.901804 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:10.902005 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.902664 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.904078 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.904658 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.904740 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:10.904748 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:10.904921 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 02:23:10.904960 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 02:23:10.905042 29947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:10.901440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:41845 (local address 127.11.93.129:43817)
0809 02:23:10.901556 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:10.901571 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:10.901621 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:10.901820 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:10.901821 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:10.901823 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:10.901907 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:10.901909 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.902791 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.902792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:10.903975 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:10.903977 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.904752 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.904753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:10.904835 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:10.904837 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 02:23:10.904897 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 02:23:10.904948 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"mutex_wait_us":6}
I20260809 02:23:10.905049 30253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:10.901445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:39733 (local address 127.11.93.129:40815)
0809 02:23:10.901682 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:10.901693 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:10.901760 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:10.901896 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:10.901897 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:10.901898 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:10.901955 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:10.901975 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.902661 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.902662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:10.903975 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:10.903978 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.904752 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.904753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:10.904832 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:10.904836 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:23:10.904897 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 02:23:10.904948 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"mutex_wait_us":59,"thread_start_us":118,"threads_started":1}
I20260809 02:23:10.905452 30037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e6a968705e342fa93201a217b31e4ad" candidate_uuid: "5de6ec4fde5441bbb8b990352ac5d35a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd45efe52ca74dafb9e438691dd10006" is_pre_election: true
I20260809 02:23:10.905620 30037 raft_consensus.cc:2454] T 5e6a968705e342fa93201a217b31e4ad P fd45efe52ca74dafb9e438691dd10006 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5de6ec4fde5441bbb8b990352ac5d35a in term 0.
I20260809 02:23:10.905702 30178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e6a968705e342fa93201a217b31e4ad" candidate_uuid: "5de6ec4fde5441bbb8b990352ac5d35a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "542f6732ffc242e2b47704195dac29f8" is_pre_election: true
I20260809 02:23:10.905848 30178 raft_consensus.cc:2454] T 5e6a968705e342fa93201a217b31e4ad P 542f6732ffc242e2b47704195dac29f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5de6ec4fde5441bbb8b990352ac5d35a in term 0.
I20260809 02:23:10.905902 29825 leader_election.cc:302] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5de6ec4fde5441bbb8b990352ac5d35a, fd45efe52ca74dafb9e438691dd10006; no voters:
I20260809 02:23:10.906034 30251 raft_consensus.cc:2781] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:23:10.906085 30251 raft_consensus.cc:482] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:23:10.906107 30251 raft_consensus.cc:3037] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:10.906860 30251 raft_consensus.cc:504] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5de6ec4fde5441bbb8b990352ac5d35a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35277 } } peers { permanent_uuid: "fd45efe52ca74dafb9e438691dd10006" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 41845 } } peers { permanent_uuid: "542f6732ffc242e2b47704195dac29f8" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 39733 } }
I20260809 02:23:10.907024 30251 leader_election.cc:288] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a [CANDIDATE]: Term 1 election: Requested vote from peers fd45efe52ca74dafb9e438691dd10006 (127.11.93.130:41845), 542f6732ffc242e2b47704195dac29f8 (127.11.93.131:39733)
I20260809 02:23:10.907143 30037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e6a968705e342fa93201a217b31e4ad" candidate_uuid: "5de6ec4fde5441bbb8b990352ac5d35a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd45efe52ca74dafb9e438691dd10006"
I20260809 02:23:10.907166 30178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e6a968705e342fa93201a217b31e4ad" candidate_uuid: "5de6ec4fde5441bbb8b990352ac5d35a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "542f6732ffc242e2b47704195dac29f8"
I20260809 02:23:10.907229 30037 raft_consensus.cc:3037] T 5e6a968705e342fa93201a217b31e4ad P fd45efe52ca74dafb9e438691dd10006 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:10.907258 30178 raft_consensus.cc:3037] T 5e6a968705e342fa93201a217b31e4ad P 542f6732ffc242e2b47704195dac29f8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:10.907989 30037 raft_consensus.cc:2454] T 5e6a968705e342fa93201a217b31e4ad P fd45efe52ca74dafb9e438691dd10006 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5de6ec4fde5441bbb8b990352ac5d35a in term 1.
I20260809 02:23:10.908005 30178 raft_consensus.cc:2454] T 5e6a968705e342fa93201a217b31e4ad P 542f6732ffc242e2b47704195dac29f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5de6ec4fde5441bbb8b990352ac5d35a in term 1.
I20260809 02:23:10.908149 29825 leader_election.cc:302] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5de6ec4fde5441bbb8b990352ac5d35a, fd45efe52ca74dafb9e438691dd10006; no voters:
I20260809 02:23:10.908233 30251 raft_consensus.cc:2781] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:10.908380 30251 raft_consensus.cc:686] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a [term 1 LEADER]: Becoming Leader. State: Replica: 5de6ec4fde5441bbb8b990352ac5d35a, State: Running, Role: LEADER
I20260809 02:23:10.908478 30251 consensus_queue.cc:237] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5de6ec4fde5441bbb8b990352ac5d35a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35277 } } peers { permanent_uuid: "fd45efe52ca74dafb9e438691dd10006" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 41845 } } peers { permanent_uuid: "542f6732ffc242e2b47704195dac29f8" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 39733 } }
I20260809 02:23:10.909291 29742 catalog_manager.cc:5495] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5de6ec4fde5441bbb8b990352ac5d35a (127.11.93.129). New cstate: current_term: 1 leader_uuid: "5de6ec4fde5441bbb8b990352ac5d35a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5de6ec4fde5441bbb8b990352ac5d35a" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 35277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd45efe52ca74dafb9e438691dd10006" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 41845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "542f6732ffc242e2b47704195dac29f8" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 39733 } health_report { overall_health: UNKNOWN } } }
I20260809 02:23:10.919760 30242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:10.917380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38172 (local address 127.11.93.129:35277)
0809 02:23:10.917421 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:10.917423 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:10.917436 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:23:10.917519 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:10.917520 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:10.917541 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:10.917594 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:10.917700 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.918162 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.918938 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:10.919153 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:10.919254 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:10.919401 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:10.919506 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:10.919571 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:10.919606 (+ 35us) server_negotiation.cc:299] Negotiation successful
0809 02:23:10.919622 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 02:23:10.921576 30037 raft_consensus.cc:1261] T 5e6a968705e342fa93201a217b31e4ad P fd45efe52ca74dafb9e438691dd10006 [term 1 FOLLOWER]: Refusing update from remote peer 5de6ec4fde5441bbb8b990352ac5d35a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:10.921576 30178 raft_consensus.cc:1261] T 5e6a968705e342fa93201a217b31e4ad P 542f6732ffc242e2b47704195dac29f8 [term 1 FOLLOWER]: Refusing update from remote peer 5de6ec4fde5441bbb8b990352ac5d35a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:10.921969 30254 consensus_queue.cc:1035] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a [LEADER]: Connected to new peer: Peer: permanent_uuid: "542f6732ffc242e2b47704195dac29f8" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 39733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:10.922192 30251 consensus_queue.cc:1035] T 5e6a968705e342fa93201a217b31e4ad P 5de6ec4fde5441bbb8b990352ac5d35a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd45efe52ca74dafb9e438691dd10006" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 41845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:10.925170 30260 mvcc.cc:205] Tried to move back new op lower bound from 7316448014012039168 to 7316448013961789440. Current Snapshot: MvccSnapshot[applied={T|T < 7316448014012039168}]
I20260809 02:23:10.927408 29742 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55394:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:23:10.927521 29742 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55394:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:23:10.928298 29742 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f45ced0c54f9465bbe8250108599440f: Sending DeleteTablet for 3 replicas of tablet 5e6a968705e342fa93201a217b31e4ad
I20260809 02:23:10.928609 29872 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e6a968705e342fa93201a217b31e4ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:10 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:38170
I20260809 02:23:10.928630 30157 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e6a968705e342fa93201a217b31e4ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:10 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:35658
I20260809 02:23:10.928851 30268 tablet_replica.cc:330] T 5e6a968705e342fa93201a217b31e4ad P 542f6732ffc242e2b47704195dac29f8: stopping tablet replica
I20260809 02:23:10.928838 30017 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e6a968705e342fa93201a217b31e4ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:10 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:58696
I20260809 02:23:10.928931 30268 raft_consensus.cc:2229] T 5e6a968705e342fa93201a217b31e4ad P 542f6732ffc242e2b47704195dac29f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:23:10.929033 30268 raft_consensus.cc:2258] T 5e6a968705e342fa93201a217b31e4ad P 542f6732ffc242e2b47704195dac29f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:23:10.929056 30270 tablet_replica.cc:330] T 5e6a968705e342fa93201a217b31e4ad P fd45efe52ca74dafb9e438691dd10006: stopping tablet replica
I20260809 02:23:10.929134 30270 raft_consensus.cc:2229] T 5e6a968705e342fa93201a217b31e4ad P fd45efe52ca74dafb9e438691dd10006 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:23:10.929214 30270 raft_consensus.cc:2258] T 5e6a968705e342fa93201a217b31e4ad P fd45efe52ca74dafb9e438691dd10006 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:23:10.929488 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 29807
I20260809 02:23:10.931161 30270 ts_tablet_manager.cc:1905] T 5e6a968705e342fa93201a217b31e4ad P fd45efe52ca74dafb9e438691dd10006: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:23:10.932467 30268 ts_tablet_manager.cc:1905] T 5e6a968705e342fa93201a217b31e4ad P 542f6732ffc242e2b47704195dac29f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:23:10.933049 30270 ts_tablet_manager.cc:1918] T 5e6a968705e342fa93201a217b31e4ad P fd45efe52ca74dafb9e438691dd10006: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:23:10.933127 30270 log.cc:1196] T 5e6a968705e342fa93201a217b31e4ad P fd45efe52ca74dafb9e438691dd10006: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/5e6a968705e342fa93201a217b31e4ad
I20260809 02:23:10.933498 30270 ts_tablet_manager.cc:1939] T 5e6a968705e342fa93201a217b31e4ad P fd45efe52ca74dafb9e438691dd10006: Deleting consensus metadata
I20260809 02:23:10.934018 29728 catalog_manager.cc:4841] TS fd45efe52ca74dafb9e438691dd10006 (127.11.93.130:41845): tablet 5e6a968705e342fa93201a217b31e4ad (table test-table [id=27c8c861dc9c45ef8064d1d4410f0e2a]) successfully deleted
I20260809 02:23:10.934360 30268 ts_tablet_manager.cc:1918] T 5e6a968705e342fa93201a217b31e4ad P 542f6732ffc242e2b47704195dac29f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:23:10.934443 30268 log.cc:1196] T 5e6a968705e342fa93201a217b31e4ad P 542f6732ffc242e2b47704195dac29f8: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/5e6a968705e342fa93201a217b31e4ad
I20260809 02:23:10.934688 30268 ts_tablet_manager.cc:1939] T 5e6a968705e342fa93201a217b31e4ad P 542f6732ffc242e2b47704195dac29f8: Deleting consensus metadata
I20260809 02:23:10.935093 29730 catalog_manager.cc:4841] TS 542f6732ffc242e2b47704195dac29f8 (127.11.93.131:39733): tablet 5e6a968705e342fa93201a217b31e4ad (table test-table [id=27c8c861dc9c45ef8064d1d4410f0e2a]) successfully deleted
W20260809 02:23:10.938150 29728 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.93.129:35277 (error 108)
I20260809 02:23:10.938704 30238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:10.938588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:35277 (local address 127.0.0.1:38186)
0809 02:23:10.938641 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:10.938677 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.129:35277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 02:23:10.938814 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 29950
W20260809 02:23:10.938843 29728 catalog_manager.cc:4584] TS 5de6ec4fde5441bbb8b990352ac5d35a (127.11.93.129:35277): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5e6a968705e342fa93201a217b31e4ad: Network error: Client connection negotiation failed: client connection to 127.11.93.129:35277: connect: Connection refused (error 111)
I20260809 02:23:10.945884 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 30091
I20260809 02:23:10.952893 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 29710
2026-08-09T02:23:10Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (1975 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-09T02:23:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:10Z Disabled control of system clock
I20260809 02:23:10.983306 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:46369
--webserver_interface=127.11.93.190
--webserver_port=0
--builtin_ntp_servers=127.11.93.148:38179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:46369
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:23:11.065231 30276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:11.065445 30276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:11.065466 30276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:11.066574 30276 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:11.066612 30276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:11.066632 30276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:11.066644 30276 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:11.066656 30276 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:11.068048 30276 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:38179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:46369
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:46369
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:11.068239 30276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:11.068465 30276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:11.073247 30285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:11.073381 30276 server_base.cc:1034] running on GCE node
W20260809 02:23:11.073303 30282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:11.073269 30283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:11.073706 30276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:11.073998 30276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:11.075135 30276 hybrid_clock.cc:648] HybridClock initialized: now 1786242191075119 us; error 37 us; skew 500 ppm
I20260809 02:23:11.076368 30276 webserver.cc:460] Webserver started at http://127.11.93.190:43005/ using document root <none> and password file <none>
I20260809 02:23:11.076607 30276 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:11.076682 30276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:11.076848 30276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:11.077950 30276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "d4bbcbb51d28404db72cb6923bbe3d7d"
format_stamp: "Formatted at 2026-08-09 02:23:11 on dist-test-slave-w206"
server_key: "6064c97d4f81cdbd9948d70c0ef5c03c"
server_key_iv: "e1e33716db35cfaf243fe1b23a5a9132"
server_key_version: "encryptionkey@0"
I20260809 02:23:11.078329 30276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "d4bbcbb51d28404db72cb6923bbe3d7d"
format_stamp: "Formatted at 2026-08-09 02:23:11 on dist-test-slave-w206"
server_key: "6064c97d4f81cdbd9948d70c0ef5c03c"
server_key_iv: "e1e33716db35cfaf243fe1b23a5a9132"
server_key_version: "encryptionkey@0"
I20260809 02:23:11.079798 30276 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:23:11.080542 30291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:11.080722 30276 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:23:11.080842 30276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "d4bbcbb51d28404db72cb6923bbe3d7d"
format_stamp: "Formatted at 2026-08-09 02:23:11 on dist-test-slave-w206"
server_key: "6064c97d4f81cdbd9948d70c0ef5c03c"
server_key_iv: "e1e33716db35cfaf243fe1b23a5a9132"
server_key_version: "encryptionkey@0"
I20260809 02:23:11.080919 30276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:11.124784 30276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:11.125169 30276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:11.125342 30276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:11.129745 30276 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:46369
I20260809 02:23:11.129789 30346 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:46369 every 8 connection(s)
I20260809 02:23:11.130172 30276 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:11.131201 30347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:11.133566 30347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d: Bootstrap starting.
I20260809 02:23:11.134137 30347 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:11.134397 30347 log.cc:824] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:11.135059 30347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d: No bootstrap required, opened a new log
I20260809 02:23:11.136665 30347 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4bbcbb51d28404db72cb6923bbe3d7d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46369 } }
I20260809 02:23:11.136802 30347 raft_consensus.cc:374] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:11.136826 30347 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4bbcbb51d28404db72cb6923bbe3d7d, State: Initialized, Role: FOLLOWER
I20260809 02:23:11.136929 30347 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4bbcbb51d28404db72cb6923bbe3d7d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46369 } }
I20260809 02:23:11.137019 30347 raft_consensus.cc:388] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:11.137053 30347 raft_consensus.cc:482] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:11.137111 30347 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:11.137660 30347 raft_consensus.cc:504] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4bbcbb51d28404db72cb6923bbe3d7d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46369 } }
I20260809 02:23:11.137784 30347 leader_election.cc:302] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d4bbcbb51d28404db72cb6923bbe3d7d; no voters:
I20260809 02:23:11.137979 30347 leader_election.cc:288] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:11.138036 30351 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:11.138248 30351 raft_consensus.cc:686] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d [term 1 LEADER]: Becoming Leader. State: Replica: d4bbcbb51d28404db72cb6923bbe3d7d, State: Running, Role: LEADER
I20260809 02:23:11.138263 30347 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:11.138408 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 30276
I20260809 02:23:11.138458 30351 consensus_queue.cc:237] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4bbcbb51d28404db72cb6923bbe3d7d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46369 } }
I20260809 02:23:11.138545 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:11.138763 11638 external_mini_cluster.cc:1428] Setting key 4a4ee35765abe797b362fd2624dfea16
I20260809 02:23:11.138991 30352 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d4bbcbb51d28404db72cb6923bbe3d7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4bbcbb51d28404db72cb6923bbe3d7d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46369 } } }
I20260809 02:23:11.139097 30352 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:11.139549 30353 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4bbcbb51d28404db72cb6923bbe3d7d. Latest consensus state: current_term: 1 leader_uuid: "d4bbcbb51d28404db72cb6923bbe3d7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4bbcbb51d28404db72cb6923bbe3d7d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46369 } } }
I20260809 02:23:11.139703 30353 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:11.139895 30360 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:11.140583 30360 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:11.142158 30360 catalog_manager.cc:1347] Generated new cluster ID: de564e4a94b44614b9050ea17196bf78
I20260809 02:23:11.142220 30360 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:11.144738 30364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:11.139466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38654 (local address 127.11.93.190:46369)
0809 02:23:11.139726 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:11.139735 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:11.139774 (+ 39us) server_negotiation.cc:407] Connection header received
0809 02:23:11.139895 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:11.139917 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:11.139998 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:11.140132 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:11.140355 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.141434 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.142552 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.143159 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.143268 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:11.144048 (+ 780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:11.144051 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:11.144051 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:11.144251 (+ 200us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:11.144291 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:11.144304 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:11.144369 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:11.144466 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 02:23:11.144537 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":81,"threads_started":1}
I20260809 02:23:11.158041 30360 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:11.158604 30360 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:11.162750 30360 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d: Generated new TSK 0
I20260809 02:23:11.163017 30360 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:11.168123 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:46369
--builtin_ntp_servers=127.11.93.148:38179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:23:11.251827 30372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:11.252032 30372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:11.252054 30372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:11.253225 30372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:11.253264 30372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:11.253319 30372 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:23:11.254696 30372 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:38179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:46369
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:11.254930 30372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:11.255251 30372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:11.261478 30378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:11.261514 30380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:11.261672 30372 server_base.cc:1034] running on GCE node
W20260809 02:23:11.261873 30377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:11.262094 30372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:11.262359 30372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:11.263513 30372 hybrid_clock.cc:648] HybridClock initialized: now 1786242191263496 us; error 32 us; skew 500 ppm
I20260809 02:23:11.264967 30372 webserver.cc:460] Webserver started at http://127.11.93.129:43685/ using document root <none> and password file <none>
I20260809 02:23:11.265245 30372 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:11.265331 30372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:11.265486 30372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:11.266878 30372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "9168a6e0c25142828a2c3826b4ddb9f9"
format_stamp: "Formatted at 2026-08-09 02:23:11 on dist-test-slave-w206"
server_key: "c163578cc5f51f47ec3cb761a3b4bb2c"
server_key_iv: "d0d8df3cbc187c32d55a0c3263ae1770"
server_key_version: "encryptionkey@0"
I20260809 02:23:11.267294 30372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "9168a6e0c25142828a2c3826b4ddb9f9"
format_stamp: "Formatted at 2026-08-09 02:23:11 on dist-test-slave-w206"
server_key: "c163578cc5f51f47ec3cb761a3b4bb2c"
server_key_iv: "d0d8df3cbc187c32d55a0c3263ae1770"
server_key_version: "encryptionkey@0"
I20260809 02:23:11.268957 30372 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:23:11.270133 30387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:11.270313 30372 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:11.270397 30372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "9168a6e0c25142828a2c3826b4ddb9f9"
format_stamp: "Formatted at 2026-08-09 02:23:11 on dist-test-slave-w206"
server_key: "c163578cc5f51f47ec3cb761a3b4bb2c"
server_key_iv: "d0d8df3cbc187c32d55a0c3263ae1770"
server_key_version: "encryptionkey@0"
I20260809 02:23:11.270489 30372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:11.281131 30372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:11.281426 30372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:11.281579 30372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:11.281806 30372 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:11.282125 30372 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:11.282178 30372 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:11.282225 30372 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:11.282254 30372 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:11.288168 30372 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:41271
I20260809 02:23:11.288249 30508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:41271 every 8 connection(s)
I20260809 02:23:11.288580 30372 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:23:11.293728 30364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:11.289359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:34529 (local address 127.11.93.190:46369)
0809 02:23:11.289411 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:11.289413 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:11.289662 (+ 249us) server_negotiation.cc:407] Connection header received
0809 02:23:11.290144 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:11.290145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:11.290158 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:11.290305 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:11.290859 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.291446 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.292399 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.292583 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.292638 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:11.293474 (+ 836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:11.293476 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:11.293476 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:11.293480 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:11.293495 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:11.293499 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:11.293554 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:11.293642 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 02:23:11.293670 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 02:23:11.293979 30511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:11.289294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:46369 (local address 127.11.93.129:34529)
0809 02:23:11.289523 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:11.289561 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:11.290061 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:11.290261 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:11.290264 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:11.290272 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:11.290776 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:11.290780 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.291550 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.291551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:11.292309 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:11.292311 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.292660 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.292661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:11.292766 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:11.293313 (+ 547us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:23:11.293313 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:11.293348 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:23:11.293371 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:11.293570 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:11.293575 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:11.293577 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 02:23:11.293630 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 02:23:11.293710 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":70,"threads_started":1}
I20260809 02:23:11.294073 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 30372
I20260809 02:23:11.294183 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:23:11.294409 11638 external_mini_cluster.cc:1428] Setting key eb497da6efdf356dc6169d4b899e9106
I20260809 02:23:11.294524 30509 heartbeater.cc:347] Connected to a master server at 127.11.93.190:46369
I20260809 02:23:11.294657 30509 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:11.294852 30509 heartbeater.cc:511] Master 127.11.93.190:46369 requested a full tablet report, sending...
I20260809 02:23:11.295434 30310 ts_manager.cc:194] Registered new tserver with Master: 9168a6e0c25142828a2c3826b4ddb9f9 (127.11.93.129:41271)
I20260809 02:23:11.295477 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:46369
--builtin_ntp_servers=127.11.93.148:38179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 02:23:11.296074 30310 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.93.129:34529
W20260809 02:23:11.378257 30512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:11.378463 30512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:11.378484 30512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:11.379688 30512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:11.379729 30512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:11.379755 30512 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:23:11.381210 30512 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:38179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:46369
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30512
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:11.381469 30512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:11.381773 30512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:11.386862 30517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:11.386915 30518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:11.386868 30520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:11.387382 30512 server_base.cc:1034] running on GCE node
I20260809 02:23:11.387578 30512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:11.387782 30512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:11.388942 30512 hybrid_clock.cc:648] HybridClock initialized: now 1786242191388929 us; error 29 us; skew 500 ppm
I20260809 02:23:11.390235 30512 webserver.cc:460] Webserver started at http://127.11.93.130:38623/ using document root <none> and password file <none>
I20260809 02:23:11.390522 30512 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:11.390571 30512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:11.390735 30512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:11.391917 30512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "45492cbd25654c37a5f81011317f7ffe"
format_stamp: "Formatted at 2026-08-09 02:23:11 on dist-test-slave-w206"
server_key: "0183d97d0f5c44101cbb744e57b33aef"
server_key_iv: "67975750be04d09a87dc94f294fb4cc1"
server_key_version: "encryptionkey@0"
I20260809 02:23:11.392285 30512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "45492cbd25654c37a5f81011317f7ffe"
format_stamp: "Formatted at 2026-08-09 02:23:11 on dist-test-slave-w206"
server_key: "0183d97d0f5c44101cbb744e57b33aef"
server_key_iv: "67975750be04d09a87dc94f294fb4cc1"
server_key_version: "encryptionkey@0"
I20260809 02:23:11.393610 30512 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 02:23:11.394379 30526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:11.394564 30512 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:23:11.394665 30512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "45492cbd25654c37a5f81011317f7ffe"
format_stamp: "Formatted at 2026-08-09 02:23:11 on dist-test-slave-w206"
server_key: "0183d97d0f5c44101cbb744e57b33aef"
server_key_iv: "67975750be04d09a87dc94f294fb4cc1"
server_key_version: "encryptionkey@0"
I20260809 02:23:11.394743 30512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:11.411931 30512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:11.412267 30512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:11.412422 30512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:11.412662 30512 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:11.413010 30512 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:11.413062 30512 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:11.413097 30512 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:11.413125 30512 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:11.418808 30512 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:36781
I20260809 02:23:11.418857 30649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:36781 every 8 connection(s)
I20260809 02:23:11.419272 30512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:23:11.421490 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 30512
I20260809 02:23:11.421629 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:23:11.421865 11638 external_mini_cluster.cc:1428] Setting key 2ba9f35725766e3a36915e647d9910c5
I20260809 02:23:11.422793 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:46369
--builtin_ntp_servers=127.11.93.148:38179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 02:23:11.425104 30364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:11.420076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:58481 (local address 127.11.93.190:46369)
0809 02:23:11.420169 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:11.420171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:11.420406 (+ 235us) server_negotiation.cc:407] Connection header received
0809 02:23:11.420902 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:11.420903 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:11.420914 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:11.420975 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:11.421932 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.422476 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.423640 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.423841 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.423919 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:11.424804 (+ 885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:11.424805 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:11.424805 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:11.424810 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:11.424826 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:11.424830 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:11.424894 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:11.424992 (+ 98us) server_negotiation.cc:299] Negotiation successful
0809 02:23:11.425024 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 02:23:11.425344 30652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:11.420051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:46369 (local address 127.11.93.130:58481)
0809 02:23:11.420278 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:11.420313 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:11.420792 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:11.421052 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:11.421056 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:11.421064 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:11.421791 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:11.421798 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.422578 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.422579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:11.423535 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:11.423538 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.423930 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.423930 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:11.424065 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:11.424637 (+ 572us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:23:11.424637 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:11.424666 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:23:11.424688 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:11.424894 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:11.424901 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:11.424904 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:23:11.424996 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 02:23:11.425101 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":121,"threads_started":1}
I20260809 02:23:11.425776 30650 heartbeater.cc:347] Connected to a master server at 127.11.93.190:46369
I20260809 02:23:11.425868 30650 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:11.426072 30650 heartbeater.cc:511] Master 127.11.93.190:46369 requested a full tablet report, sending...
I20260809 02:23:11.426517 30310 ts_manager.cc:194] Registered new tserver with Master: 45492cbd25654c37a5f81011317f7ffe (127.11.93.130:36781)
I20260809 02:23:11.426904 30310 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.93.130:58481
W20260809 02:23:11.507000 30653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:11.507282 30653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:11.507321 30653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:11.508550 30653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:11.508611 30653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:11.508651 30653 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:23:11.510020 30653 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:38179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:46369
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:11.510285 30653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:11.510623 30653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:11.515879 30658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:11.515906 30659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:11.515875 30662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:11.516140 30653 server_base.cc:1034] running on GCE node
I20260809 02:23:11.516403 30653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:11.516656 30653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:11.517818 30653 hybrid_clock.cc:648] HybridClock initialized: now 1786242191517809 us; error 44 us; skew 500 ppm
I20260809 02:23:11.519277 30653 webserver.cc:460] Webserver started at http://127.11.93.131:39803/ using document root <none> and password file <none>
I20260809 02:23:11.519529 30653 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:11.519601 30653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:11.519753 30653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:11.520937 30653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "203a58f8c7874e20b5aa0978dc5bee1d"
format_stamp: "Formatted at 2026-08-09 02:23:11 on dist-test-slave-w206"
server_key: "925a08cb63db83c40249a7f4b8a35221"
server_key_iv: "edf6521a9735675f8cc2e25249ee9bad"
server_key_version: "encryptionkey@0"
I20260809 02:23:11.521304 30653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "203a58f8c7874e20b5aa0978dc5bee1d"
format_stamp: "Formatted at 2026-08-09 02:23:11 on dist-test-slave-w206"
server_key: "925a08cb63db83c40249a7f4b8a35221"
server_key_iv: "edf6521a9735675f8cc2e25249ee9bad"
server_key_version: "encryptionkey@0"
I20260809 02:23:11.522648 30653 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:23:11.523478 30668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:11.523643 30653 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:11.523751 30653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "203a58f8c7874e20b5aa0978dc5bee1d"
format_stamp: "Formatted at 2026-08-09 02:23:11 on dist-test-slave-w206"
server_key: "925a08cb63db83c40249a7f4b8a35221"
server_key_iv: "edf6521a9735675f8cc2e25249ee9bad"
server_key_version: "encryptionkey@0"
I20260809 02:23:11.523844 30653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:11.545471 30653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:11.545812 30653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:11.545987 30653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:11.546247 30653 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:11.546599 30653 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:11.546654 30653 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:11.546697 30653 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:11.546726 30653 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:11.552578 30653 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:46203
I20260809 02:23:11.552626 30790 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:46203 every 8 connection(s)
I20260809 02:23:11.553000 30653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:23:11.558068 30364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:11.553748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:41643 (local address 127.11.93.190:46369)
0809 02:23:11.553816 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:11.553818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:11.554048 (+ 230us) server_negotiation.cc:407] Connection header received
0809 02:23:11.554552 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:11.554553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:11.554564 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:11.554626 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:11.555366 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.555860 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.556797 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.557049 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.557104 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:11.557861 (+ 757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:11.557862 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:11.557862 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:11.557866 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:11.557879 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:11.557883 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:11.557929 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:11.557989 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 02:23:11.558010 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:23:11.558285 30793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:11.553716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:46369 (local address 127.11.93.131:41643)
0809 02:23:11.553927 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:11.553970 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:11.554464 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:11.554697 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:11.554700 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:11.554708 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:11.555279 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:11.555284 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.555936 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.555937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:11.556704 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:11.556706 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.557126 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.557126 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:11.557240 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:11.557736 (+ 496us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:23:11.557736 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:11.557763 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:23:11.557783 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:11.557929 (+ 146us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:11.557931 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:11.557933 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 02:23:11.557978 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 02:23:11.558052 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":110,"threads_started":1}
I20260809 02:23:11.558893 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 30653
I20260809 02:23:11.558897 30791 heartbeater.cc:347] Connected to a master server at 127.11.93.190:46369
I20260809 02:23:11.559019 30791 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:11.559031 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:23:11.559214 30791 heartbeater.cc:511] Master 127.11.93.190:46369 requested a full tablet report, sending...
I20260809 02:23:11.559230 11638 external_mini_cluster.cc:1428] Setting key b87022e149f1a9ee28638dde9289780b
I20260809 02:23:11.559579 30310 ts_manager.cc:194] Registered new tserver with Master: 203a58f8c7874e20b5aa0978dc5bee1d (127.11.93.131:46203)
I20260809 02:23:11.560055 30310 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.93.131:41643
I20260809 02:23:11.560286 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:23:11.564514 30364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:11.561613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38664 (local address 127.11.93.190:46369)
0809 02:23:11.561677 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:11.561679 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:11.561820 (+ 141us) server_negotiation.cc:407] Connection header received
0809 02:23:11.561896 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:11.561897 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:11.561909 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:11.561964 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:11.562137 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.562586 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.563410 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.563612 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.563685 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:11.564273 (+ 588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:11.564274 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:11.564275 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:11.564279 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:11.564291 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:11.564295 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:11.564341 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:11.564402 (+ 61us) server_negotiation.cc:299] Negotiation successful
0809 02:23:11.564425 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 02:23:11.566028 30310 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38664:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:23:11.567601 30310 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:23:11.574012 30806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:11.569990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47244 (local address 127.11.93.129:41271)
0809 02:23:11.570174 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:11.570178 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:11.570322 (+ 144us) server_negotiation.cc:407] Connection header received
0809 02:23:11.570370 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:11.570372 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:11.570389 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:11.570469 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:11.570653 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.571778 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.572832 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.573577 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.573693 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:11.573786 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:11.573878 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 02:23:11.573915 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":75,"threads_started":1}
I20260809 02:23:11.574004 30801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:11.569755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:41271 (local address 127.0.0.1:47244)
0809 02:23:11.570229 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:11.570240 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:11.570298 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:11.570539 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:11.570539 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:11.570541 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:11.570576 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:11.570577 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.571863 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.571864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:11.572742 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:11.572744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.573706 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.573707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:11.573781 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:11.573795 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 02:23:11.573867 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 02:23:11.573923 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":101,"threads_started":1}
I20260809 02:23:11.574186 30804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:11.569824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52910 (local address 127.11.93.130:36781)
0809 02:23:11.570419 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:11.570423 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:11.570432 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:23:11.570483 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:11.570485 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:11.570500 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:11.570573 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:11.570768 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.571549 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.573062 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.573601 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.573693 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:11.573787 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:11.574049 (+ 262us) server_negotiation.cc:299] Negotiation successful
0809 02:23:11.574090 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":91,"threads_started":1}
I20260809 02:23:11.574340 30805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:11.569953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42082 (local address 127.11.93.131:46203)
0809 02:23:11.570143 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:11.570148 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:11.570159 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:23:11.570199 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:11.570201 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:11.570218 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:11.570312 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:11.570522 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.571740 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.573012 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.573679 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.573748 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:11.573818 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:11.574046 (+ 228us) server_negotiation.cc:299] Negotiation successful
0809 02:23:11.574259 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":76,"threads_started":1}
I20260809 02:23:11.574448 30800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:11.569734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:36781 (local address 127.0.0.1:52910)
0809 02:23:11.570002 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:11.570012 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:11.570053 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:11.570639 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:11.570640 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:11.570642 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:11.570688 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:11.570690 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.571639 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.571640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:11.572920 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:11.572923 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.573819 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.573820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:11.573889 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:11.573892 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:23:11.573937 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 02:23:11.573969 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":2,"thread_start_us":53,"threads_started":1}
I20260809 02:23:11.574476 30803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:11.569732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:46203 (local address 127.0.0.1:42082)
0809 02:23:11.569917 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:11.569956 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:11.570026 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:11.570334 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:11.570337 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:11.570340 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:11.570417 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:11.570440 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.571835 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.571836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:11.572920 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:11.572923 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.573852 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.573854 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:11.573911 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:11.573915 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:23:11.573965 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 02:23:11.574004 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":2,"thread_start_us":112,"threads_started":1}
I20260809 02:23:11.574887 30440 tablet_service.cc:1467] Processing CreateTablet for tablet f627cdf34db845ddb230b3ee615a2534 (DEFAULT_TABLE table=test-table [id=92dd687e8800448b84769b4d69813678]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:11.575156 30580 tablet_service.cc:1467] Processing CreateTablet for tablet f627cdf34db845ddb230b3ee615a2534 (DEFAULT_TABLE table=test-table [id=92dd687e8800448b84769b4d69813678]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:11.575294 30440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f627cdf34db845ddb230b3ee615a2534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:11.575464 30580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f627cdf34db845ddb230b3ee615a2534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:11.575387 30721 tablet_service.cc:1467] Processing CreateTablet for tablet f627cdf34db845ddb230b3ee615a2534 (DEFAULT_TABLE table=test-table [id=92dd687e8800448b84769b4d69813678]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:11.575683 30721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f627cdf34db845ddb230b3ee615a2534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:11.578619 30809 tablet_bootstrap.cc:492] T f627cdf34db845ddb230b3ee615a2534 P 9168a6e0c25142828a2c3826b4ddb9f9: Bootstrap starting.
I20260809 02:23:11.578677 30807 tablet_bootstrap.cc:492] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d: Bootstrap starting.
I20260809 02:23:11.579133 30808 tablet_bootstrap.cc:492] T f627cdf34db845ddb230b3ee615a2534 P 45492cbd25654c37a5f81011317f7ffe: Bootstrap starting.
I20260809 02:23:11.579312 30807 tablet_bootstrap.cc:654] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:11.579332 30809 tablet_bootstrap.cc:654] T f627cdf34db845ddb230b3ee615a2534 P 9168a6e0c25142828a2c3826b4ddb9f9: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:11.579597 30807 log.cc:824] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:11.579659 30809 log.cc:824] T f627cdf34db845ddb230b3ee615a2534 P 9168a6e0c25142828a2c3826b4ddb9f9: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:11.579842 30808 tablet_bootstrap.cc:654] T f627cdf34db845ddb230b3ee615a2534 P 45492cbd25654c37a5f81011317f7ffe: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:11.580168 30808 log.cc:824] T f627cdf34db845ddb230b3ee615a2534 P 45492cbd25654c37a5f81011317f7ffe: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:11.580394 30807 tablet_bootstrap.cc:492] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d: No bootstrap required, opened a new log
I20260809 02:23:11.580473 30807 ts_tablet_manager.cc:1397] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:23:11.580835 30808 tablet_bootstrap.cc:492] T f627cdf34db845ddb230b3ee615a2534 P 45492cbd25654c37a5f81011317f7ffe: No bootstrap required, opened a new log
I20260809 02:23:11.580886 30808 ts_tablet_manager.cc:1397] T f627cdf34db845ddb230b3ee615a2534 P 45492cbd25654c37a5f81011317f7ffe: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:23:11.582475 30807 raft_consensus.cc:348] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203a58f8c7874e20b5aa0978dc5bee1d" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 46203 } } peers { permanent_uuid: "45492cbd25654c37a5f81011317f7ffe" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36781 } } peers { permanent_uuid: "9168a6e0c25142828a2c3826b4ddb9f9" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 41271 } }
I20260809 02:23:11.582633 30807 raft_consensus.cc:374] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:11.582679 30807 raft_consensus.cc:729] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203a58f8c7874e20b5aa0978dc5bee1d, State: Initialized, Role: FOLLOWER
I20260809 02:23:11.582798 30807 consensus_queue.cc:260] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203a58f8c7874e20b5aa0978dc5bee1d" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 46203 } } peers { permanent_uuid: "45492cbd25654c37a5f81011317f7ffe" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36781 } } peers { permanent_uuid: "9168a6e0c25142828a2c3826b4ddb9f9" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 41271 } }
I20260809 02:23:11.582934 30808 raft_consensus.cc:348] T f627cdf34db845ddb230b3ee615a2534 P 45492cbd25654c37a5f81011317f7ffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203a58f8c7874e20b5aa0978dc5bee1d" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 46203 } } peers { permanent_uuid: "45492cbd25654c37a5f81011317f7ffe" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36781 } } peers { permanent_uuid: "9168a6e0c25142828a2c3826b4ddb9f9" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 41271 } }
I20260809 02:23:11.583112 30807 ts_tablet_manager.cc:1428] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260809 02:23:11.583140 30808 raft_consensus.cc:374] T f627cdf34db845ddb230b3ee615a2534 P 45492cbd25654c37a5f81011317f7ffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:11.583244 30791 heartbeater.cc:503] Master 127.11.93.190:46369 was elected leader, sending a full tablet report...
I20260809 02:23:11.583485 30808 raft_consensus.cc:729] T f627cdf34db845ddb230b3ee615a2534 P 45492cbd25654c37a5f81011317f7ffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45492cbd25654c37a5f81011317f7ffe, State: Initialized, Role: FOLLOWER
I20260809 02:23:11.583611 30809 tablet_bootstrap.cc:492] T f627cdf34db845ddb230b3ee615a2534 P 9168a6e0c25142828a2c3826b4ddb9f9: No bootstrap required, opened a new log
I20260809 02:23:11.583628 30808 consensus_queue.cc:260] T f627cdf34db845ddb230b3ee615a2534 P 45492cbd25654c37a5f81011317f7ffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203a58f8c7874e20b5aa0978dc5bee1d" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 46203 } } peers { permanent_uuid: "45492cbd25654c37a5f81011317f7ffe" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36781 } } peers { permanent_uuid: "9168a6e0c25142828a2c3826b4ddb9f9" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 41271 } }
I20260809 02:23:11.583676 30809 ts_tablet_manager.cc:1397] T f627cdf34db845ddb230b3ee615a2534 P 9168a6e0c25142828a2c3826b4ddb9f9: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 02:23:11.583900 30808 ts_tablet_manager.cc:1428] T f627cdf34db845ddb230b3ee615a2534 P 45492cbd25654c37a5f81011317f7ffe: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 02:23:11.583940 30650 heartbeater.cc:503] Master 127.11.93.190:46369 was elected leader, sending a full tablet report...
I20260809 02:23:11.585532 30809 raft_consensus.cc:348] T f627cdf34db845ddb230b3ee615a2534 P 9168a6e0c25142828a2c3826b4ddb9f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203a58f8c7874e20b5aa0978dc5bee1d" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 46203 } } peers { permanent_uuid: "45492cbd25654c37a5f81011317f7ffe" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36781 } } peers { permanent_uuid: "9168a6e0c25142828a2c3826b4ddb9f9" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 41271 } }
I20260809 02:23:11.585649 30809 raft_consensus.cc:374] T f627cdf34db845ddb230b3ee615a2534 P 9168a6e0c25142828a2c3826b4ddb9f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:11.585669 30809 raft_consensus.cc:729] T f627cdf34db845ddb230b3ee615a2534 P 9168a6e0c25142828a2c3826b4ddb9f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9168a6e0c25142828a2c3826b4ddb9f9, State: Initialized, Role: FOLLOWER
I20260809 02:23:11.585806 30809 consensus_queue.cc:260] T f627cdf34db845ddb230b3ee615a2534 P 9168a6e0c25142828a2c3826b4ddb9f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203a58f8c7874e20b5aa0978dc5bee1d" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 46203 } } peers { permanent_uuid: "45492cbd25654c37a5f81011317f7ffe" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36781 } } peers { permanent_uuid: "9168a6e0c25142828a2c3826b4ddb9f9" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 41271 } }
I20260809 02:23:11.586054 30809 ts_tablet_manager.cc:1428] T f627cdf34db845ddb230b3ee615a2534 P 9168a6e0c25142828a2c3826b4ddb9f9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:23:11.586138 30509 heartbeater.cc:503] Master 127.11.93.190:46369 was elected leader, sending a full tablet report...
I20260809 02:23:11.620177 30814 raft_consensus.cc:482] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:23:11.620301 30814 raft_consensus.cc:504] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203a58f8c7874e20b5aa0978dc5bee1d" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 46203 } } peers { permanent_uuid: "45492cbd25654c37a5f81011317f7ffe" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36781 } } peers { permanent_uuid: "9168a6e0c25142828a2c3826b4ddb9f9" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 41271 } }
I20260809 02:23:11.620759 30814 leader_election.cc:288] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45492cbd25654c37a5f81011317f7ffe (127.11.93.130:36781), 9168a6e0c25142828a2c3826b4ddb9f9 (127.11.93.129:41271)
I20260809 02:23:11.624753 30806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:11.621031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:51741 (local address 127.11.93.129:41271)
0809 02:23:11.621110 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:11.621112 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:11.621121 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:23:11.621151 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:11.621151 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:11.621163 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:11.621223 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:11.621468 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.622243 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.623761 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.624334 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.624416 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:11.624425 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:11.624637 (+ 212us) server_negotiation.cc:299] Negotiation successful
0809 02:23:11.624677 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 02:23:11.624753 30804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:11.621148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:59791 (local address 127.11.93.130:36781)
0809 02:23:11.621208 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:11.621210 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:11.621232 (+ 22us) server_negotiation.cc:407] Connection header received
0809 02:23:11.621294 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:11.621295 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:11.621302 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:11.621354 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:11.621555 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.622241 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.623759 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.624334 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.624416 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:11.624425 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:11.624637 (+ 212us) server_negotiation.cc:299] Negotiation successful
0809 02:23:11.624677 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 02:23:11.624766 30793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:11.620946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:41271 (local address 127.11.93.131:51741)
0809 02:23:11.620988 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:11.621000 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:11.621080 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:11.621273 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:11.621274 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:11.621276 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:11.621384 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:11.621386 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.622336 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.622337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:11.623651 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:11.623655 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.624446 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.624447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:11.624543 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:11.624547 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:23:11.624618 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 02:23:11.624668 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20,"mutex_wait_us":38}
I20260809 02:23:11.624784 30817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:11.620975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:36781 (local address 127.11.93.131:59791)
0809 02:23:11.621168 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:11.621178 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:11.621232 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:11.621385 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:11.621385 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:11.621387 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:11.621472 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:11.621474 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.622336 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.622337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:11.623651 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:11.623655 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.624446 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.624447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:11.624542 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:11.624547 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:23:11.624618 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 02:23:11.624665 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":90,"thread_start_us":120,"threads_started":1}
I20260809 02:23:11.625200 30461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f627cdf34db845ddb230b3ee615a2534" candidate_uuid: "203a58f8c7874e20b5aa0978dc5bee1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9168a6e0c25142828a2c3826b4ddb9f9" is_pre_election: true
I20260809 02:23:11.625392 30461 raft_consensus.cc:2454] T f627cdf34db845ddb230b3ee615a2534 P 9168a6e0c25142828a2c3826b4ddb9f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203a58f8c7874e20b5aa0978dc5bee1d in term 0.
I20260809 02:23:11.625485 30601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f627cdf34db845ddb230b3ee615a2534" candidate_uuid: "203a58f8c7874e20b5aa0978dc5bee1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45492cbd25654c37a5f81011317f7ffe" is_pre_election: true
I20260809 02:23:11.625643 30601 raft_consensus.cc:2454] T f627cdf34db845ddb230b3ee615a2534 P 45492cbd25654c37a5f81011317f7ffe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203a58f8c7874e20b5aa0978dc5bee1d in term 0.
I20260809 02:23:11.625661 30673 leader_election.cc:302] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203a58f8c7874e20b5aa0978dc5bee1d, 9168a6e0c25142828a2c3826b4ddb9f9; no voters:
I20260809 02:23:11.625780 30814 raft_consensus.cc:2781] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:23:11.625864 30814 raft_consensus.cc:482] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:23:11.625890 30814 raft_consensus.cc:3037] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:11.626655 30814 raft_consensus.cc:504] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203a58f8c7874e20b5aa0978dc5bee1d" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 46203 } } peers { permanent_uuid: "45492cbd25654c37a5f81011317f7ffe" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36781 } } peers { permanent_uuid: "9168a6e0c25142828a2c3826b4ddb9f9" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 41271 } }
I20260809 02:23:11.626811 30814 leader_election.cc:288] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d [CANDIDATE]: Term 1 election: Requested vote from peers 45492cbd25654c37a5f81011317f7ffe (127.11.93.130:36781), 9168a6e0c25142828a2c3826b4ddb9f9 (127.11.93.129:41271)
I20260809 02:23:11.626961 30601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f627cdf34db845ddb230b3ee615a2534" candidate_uuid: "203a58f8c7874e20b5aa0978dc5bee1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45492cbd25654c37a5f81011317f7ffe"
I20260809 02:23:11.627013 30461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f627cdf34db845ddb230b3ee615a2534" candidate_uuid: "203a58f8c7874e20b5aa0978dc5bee1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9168a6e0c25142828a2c3826b4ddb9f9"
I20260809 02:23:11.627067 30601 raft_consensus.cc:3037] T f627cdf34db845ddb230b3ee615a2534 P 45492cbd25654c37a5f81011317f7ffe [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:11.627104 30461 raft_consensus.cc:3037] T f627cdf34db845ddb230b3ee615a2534 P 9168a6e0c25142828a2c3826b4ddb9f9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:11.627766 30601 raft_consensus.cc:2454] T f627cdf34db845ddb230b3ee615a2534 P 45492cbd25654c37a5f81011317f7ffe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203a58f8c7874e20b5aa0978dc5bee1d in term 1.
I20260809 02:23:11.627974 30461 raft_consensus.cc:2454] T f627cdf34db845ddb230b3ee615a2534 P 9168a6e0c25142828a2c3826b4ddb9f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203a58f8c7874e20b5aa0978dc5bee1d in term 1.
I20260809 02:23:11.627991 30669 leader_election.cc:302] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203a58f8c7874e20b5aa0978dc5bee1d, 45492cbd25654c37a5f81011317f7ffe; no voters:
I20260809 02:23:11.628085 30814 raft_consensus.cc:2781] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:11.628279 30814 raft_consensus.cc:686] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d [term 1 LEADER]: Becoming Leader. State: Replica: 203a58f8c7874e20b5aa0978dc5bee1d, State: Running, Role: LEADER
I20260809 02:23:11.628382 30814 consensus_queue.cc:237] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203a58f8c7874e20b5aa0978dc5bee1d" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 46203 } } peers { permanent_uuid: "45492cbd25654c37a5f81011317f7ffe" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36781 } } peers { permanent_uuid: "9168a6e0c25142828a2c3826b4ddb9f9" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 41271 } }
I20260809 02:23:11.629300 30309 catalog_manager.cc:5495] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 203a58f8c7874e20b5aa0978dc5bee1d (127.11.93.131). New cstate: current_term: 1 leader_uuid: "203a58f8c7874e20b5aa0978dc5bee1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203a58f8c7874e20b5aa0978dc5bee1d" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 46203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45492cbd25654c37a5f81011317f7ffe" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9168a6e0c25142828a2c3826b4ddb9f9" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 41271 } health_report { overall_health: UNKNOWN } } }
I20260809 02:23:11.648268 30805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:11.645784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42088 (local address 127.11.93.131:46203)
0809 02:23:11.645855 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:11.645857 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:11.645865 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:23:11.645895 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:11.645896 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:11.645912 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:11.645970 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:11.646094 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.646558 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.647487 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:11.647669 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:11.647723 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:11.647924 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:11.648020 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:11.648077 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:11.648180 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 02:23:11.648195 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 02:23:11.650117 30461 raft_consensus.cc:1261] T f627cdf34db845ddb230b3ee615a2534 P 9168a6e0c25142828a2c3826b4ddb9f9 [term 1 FOLLOWER]: Refusing update from remote peer 203a58f8c7874e20b5aa0978dc5bee1d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:11.650130 30601 raft_consensus.cc:1261] T f627cdf34db845ddb230b3ee615a2534 P 45492cbd25654c37a5f81011317f7ffe [term 1 FOLLOWER]: Refusing update from remote peer 203a58f8c7874e20b5aa0978dc5bee1d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:11.650481 30818 consensus_queue.cc:1035] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9168a6e0c25142828a2c3826b4ddb9f9" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 41271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:11.650614 30814 consensus_queue.cc:1035] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "45492cbd25654c37a5f81011317f7ffe" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 36781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:11.653681 30822 mvcc.cc:205] Tried to move back new op lower bound from 7316448016996315136 to 7316448016910659584. Current Snapshot: MvccSnapshot[applied={T|T < 7316448016996315136}]
I20260809 02:23:11.653800 30823 mvcc.cc:205] Tried to move back new op lower bound from 7316448016996315136 to 7316448016910659584. Current Snapshot: MvccSnapshot[applied={T|T < 7316448016996315136}]
I20260809 02:23:11.655089 30310 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:23:11.655190 30310 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:23:11.656078 30310 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d4bbcbb51d28404db72cb6923bbe3d7d: Sending DeleteTablet for 3 replicas of tablet f627cdf34db845ddb230b3ee615a2534
I20260809 02:23:11.656441 30721 tablet_service.cc:1514] Processing DeleteTablet for tablet f627cdf34db845ddb230b3ee615a2534 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:11 UTC) from {username='slave'} at 127.0.0.1:42082
I20260809 02:23:11.656447 30440 tablet_service.cc:1514] Processing DeleteTablet for tablet f627cdf34db845ddb230b3ee615a2534 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:11 UTC) from {username='slave'} at 127.0.0.1:47244
I20260809 02:23:11.656673 30830 tablet_replica.cc:330] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d: stopping tablet replica
I20260809 02:23:11.656667 30580 tablet_service.cc:1514] Processing DeleteTablet for tablet f627cdf34db845ddb230b3ee615a2534 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:11 UTC) from {username='slave'} at 127.0.0.1:52910
I20260809 02:23:11.656755 30830 raft_consensus.cc:2229] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:23:11.656875 30830 raft_consensus.cc:2258] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:23:11.656889 30832 tablet_replica.cc:330] T f627cdf34db845ddb230b3ee615a2534 P 45492cbd25654c37a5f81011317f7ffe: stopping tablet replica
I20260809 02:23:11.657306 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 30372
I20260809 02:23:11.657331 30831 tablet_replica.cc:330] T f627cdf34db845ddb230b3ee615a2534 P 9168a6e0c25142828a2c3826b4ddb9f9: stopping tablet replica
I20260809 02:23:11.657508 30831 raft_consensus.cc:2229] T f627cdf34db845ddb230b3ee615a2534 P 9168a6e0c25142828a2c3826b4ddb9f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:23:11.657598 30830 ts_tablet_manager.cc:1905] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:23:11.660027 30830 ts_tablet_manager.cc:1918] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:23:11.660126 30830 log.cc:1196] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/f627cdf34db845ddb230b3ee615a2534
I20260809 02:23:11.657100 30832 raft_consensus.cc:2229] T f627cdf34db845ddb230b3ee615a2534 P 45492cbd25654c37a5f81011317f7ffe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:23:11.660454 30832 raft_consensus.cc:2258] T f627cdf34db845ddb230b3ee615a2534 P 45492cbd25654c37a5f81011317f7ffe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:23:11.660465 30830 ts_tablet_manager.cc:1939] T f627cdf34db845ddb230b3ee615a2534 P 203a58f8c7874e20b5aa0978dc5bee1d: Deleting consensus metadata
I20260809 02:23:11.660923 30293 catalog_manager.cc:4841] TS 203a58f8c7874e20b5aa0978dc5bee1d (127.11.93.131:46203): tablet f627cdf34db845ddb230b3ee615a2534 (table test-table [id=92dd687e8800448b84769b4d69813678]) successfully deleted
I20260809 02:23:11.661192 30832 ts_tablet_manager.cc:1905] T f627cdf34db845ddb230b3ee615a2534 P 45492cbd25654c37a5f81011317f7ffe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:23:11.662776 30832 ts_tablet_manager.cc:1918] T f627cdf34db845ddb230b3ee615a2534 P 45492cbd25654c37a5f81011317f7ffe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:23:11.662860 30832 log.cc:1196] T f627cdf34db845ddb230b3ee615a2534 P 45492cbd25654c37a5f81011317f7ffe: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/f627cdf34db845ddb230b3ee615a2534
I20260809 02:23:11.663157 30832 ts_tablet_manager.cc:1939] T f627cdf34db845ddb230b3ee615a2534 P 45492cbd25654c37a5f81011317f7ffe: Deleting consensus metadata
I20260809 02:23:11.663954 30292 catalog_manager.cc:4841] TS 45492cbd25654c37a5f81011317f7ffe (127.11.93.130:36781): tablet f627cdf34db845ddb230b3ee615a2534 (table test-table [id=92dd687e8800448b84769b4d69813678]) successfully deleted
W20260809 02:23:11.668507 30295 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.93.129:41271 (error 108)
I20260809 02:23:11.668736 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 30512
I20260809 02:23:11.669670 30800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:11.668879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:41271 (local address 127.0.0.1:47254)
0809 02:23:11.669583 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:11.669630 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.129:41271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":681}
W20260809 02:23:11.670375 30295 catalog_manager.cc:4584] TS 9168a6e0c25142828a2c3826b4ddb9f9 (127.11.93.129:41271): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f627cdf34db845ddb230b3ee615a2534: Network error: Client connection negotiation failed: client connection to 127.11.93.129:41271: connect: Connection refused (error 111)
I20260809 02:23:11.676013 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 30653
I20260809 02:23:11.681703 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 30276
2026-08-09T02:23:11Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (727 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:11 dist-test-slave-w206 krb5kdc[30836](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:11 dist-test-slave-w206 krb5kdc[30836](info): set up 2 sockets
Aug 09 02:23:11 dist-test-slave-w206 krb5kdc[30836](info): commencing operation
krb5kdc: starting...
W20260809 02:23:12.770646 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.068s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:23:12 dist-test-slave-w206 krb5kdc[30836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242192, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:23:12.898680 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:39653
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:46123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:39653
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:12.982414 30851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:12.982671 30851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:12.982713 30851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:12.983899 30851 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:12.983989 30851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:12.984017 30851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:12.984050 30851 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:12.984079 30851 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:12.985611 30851 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:46123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:39653
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:39653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30851
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:12.985896 30851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:12.986146 30851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:12.991132 30857 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:12.991140 30856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:12.991133 30859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:12.991325 30851 server_base.cc:1034] running on GCE node
I20260809 02:23:12.991763 30851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:12.992089 30851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:12.993299 30851 hybrid_clock.cc:648] HybridClock initialized: now 1786242192993264 us; error 70 us; skew 500 ppm
Aug 09 02:23:12 dist-test-slave-w206 krb5kdc[30836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242192, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:12.995993 30851 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:23:12.996461 30851 webserver.cc:460] Webserver started at http://127.11.93.190:42005/ using document root <none> and password file <none>
I20260809 02:23:12.996711 30851 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:12.996780 30851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:12.996929 30851 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:12.997991 30851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "996b8d50169244f1a215177992e003d5"
format_stamp: "Formatted at 2026-08-09 02:23:12 on dist-test-slave-w206"
server_key: "1106b115c8b9cf3d6c863aae8b886bed"
server_key_iv: "e199a3f56a751dbbea6db45bd4778ea1"
server_key_version: "encryptionkey@0"
I20260809 02:23:12.998410 30851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "996b8d50169244f1a215177992e003d5"
format_stamp: "Formatted at 2026-08-09 02:23:12 on dist-test-slave-w206"
server_key: "1106b115c8b9cf3d6c863aae8b886bed"
server_key_iv: "e199a3f56a751dbbea6db45bd4778ea1"
server_key_version: "encryptionkey@0"
I20260809 02:23:12.999861 30851 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 02:23:13.000777 30866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:13.000995 30851 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:13.001106 30851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "996b8d50169244f1a215177992e003d5"
format_stamp: "Formatted at 2026-08-09 02:23:12 on dist-test-slave-w206"
server_key: "1106b115c8b9cf3d6c863aae8b886bed"
server_key_iv: "e199a3f56a751dbbea6db45bd4778ea1"
server_key_version: "encryptionkey@0"
I20260809 02:23:13.001245 30851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:13.014926 30851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:13.016834 30851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:13.016973 30851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:13.021065 30851 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:39653
I20260809 02:23:13.021117 30924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:39653 every 8 connection(s)
I20260809 02:23:13.021468 30851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:13.022383 30925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:13.024269 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 30851
I20260809 02:23:13.024372 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:13.024578 11638 external_mini_cluster.cc:1428] Setting key 3b2c9b3fe293e51746ac1084a1a241c7
I20260809 02:23:13.024868 30925 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5: Bootstrap starting.
I20260809 02:23:13.025628 30925 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:13.025971 30925 log.cc:824] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:13.026758 30925 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5: No bootstrap required, opened a new log
I20260809 02:23:13.029042 30925 raft_consensus.cc:348] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "996b8d50169244f1a215177992e003d5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 39653 } }
I20260809 02:23:13.029201 30925 raft_consensus.cc:374] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:13.029237 30925 raft_consensus.cc:729] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 996b8d50169244f1a215177992e003d5, State: Initialized, Role: FOLLOWER
I20260809 02:23:13.029352 30925 consensus_queue.cc:260] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "996b8d50169244f1a215177992e003d5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 39653 } }
I20260809 02:23:13.029423 30925 raft_consensus.cc:388] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:13.029459 30925 raft_consensus.cc:482] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:13.029505 30925 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:13.030242 30925 raft_consensus.cc:504] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "996b8d50169244f1a215177992e003d5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 39653 } }
I20260809 02:23:13.030352 30925 leader_election.cc:302] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 996b8d50169244f1a215177992e003d5; no voters:
I20260809 02:23:13.030553 30925 leader_election.cc:288] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:13.030582 30932 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:13.030700 30932 raft_consensus.cc:686] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5 [term 1 LEADER]: Becoming Leader. State: Replica: 996b8d50169244f1a215177992e003d5, State: Running, Role: LEADER
I20260809 02:23:13.030831 30925 sys_catalog.cc:564] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:13.030846 30932 consensus_queue.cc:237] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "996b8d50169244f1a215177992e003d5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 39653 } }
I20260809 02:23:13.031348 30935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 996b8d50169244f1a215177992e003d5. Latest consensus state: current_term: 1 leader_uuid: "996b8d50169244f1a215177992e003d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "996b8d50169244f1a215177992e003d5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 39653 } } }
I20260809 02:23:13.031416 30934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "996b8d50169244f1a215177992e003d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "996b8d50169244f1a215177992e003d5" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 39653 } } }
I20260809 02:23:13.031533 30934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:13.031783 30935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:13.031773 30942 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 09 02:23:13 dist-test-slave-w206 krb5kdc[30836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242192, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:23:13.032481 30942 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:13.034109 30942 catalog_manager.cc:1347] Generated new cluster ID: bd6e1da027e34f84abc3acc2348d4273
I20260809 02:23:13.034164 30942 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:13.037972 30929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.025172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39956 (local address 127.11.93.190:39653)
0809 02:23:13.025381 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:13.025390 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:13.025424 (+ 34us) server_negotiation.cc:407] Connection header received
0809 02:23:13.026055 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:13.026064 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:13.026128 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:13.026269 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:13.027013 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.028430 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.029218 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.029827 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.029953 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.033031 (+ 3078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:13.033035 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:13.033035 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:13.033047 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:13.036011 (+ 2964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:13.036455 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:13.036458 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:13.036458 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:13.036574 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:13.036835 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:13.036836 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:13.036836 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:13.037164 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:13.037331 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:13.037446 (+ 115us) server_negotiation.cc:299] Negotiation successful
0809 02:23:13.037590 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":82,"threads_started":1}
I20260809 02:23:13.044049 30942 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:13.044754 30942 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:13.047750 30942 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5: Generated new TSK 0
I20260809 02:23:13.047921 30942 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.93.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
I20260809 02:23:13.074576 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:39653
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:46123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:13.157383 30954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:13.157598 30954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:13.157621 30954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:13.158754 30954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:13.158797 30954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:13.158823 30954 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:23:13.160389 30954 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:46123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:39653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:13.160768 30954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:13.161017 30954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:13.166291 30959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:13.166390 30960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:13.166296 30962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:13.166399 30954 server_base.cc:1034] running on GCE node
I20260809 02:23:13.166671 30954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:13.166872 30954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:13.168040 30954 hybrid_clock.cc:648] HybridClock initialized: now 1786242193168022 us; error 34 us; skew 500 ppm
Aug 09 02:23:13 dist-test-slave-w206 krb5kdc[30836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242193, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:13.170640 30954 init.cc:377] Logged in from keytab as kudu/127.11.93.129@KRBTEST.COM (short username kudu)
I20260809 02:23:13.171130 30954 webserver.cc:460] Webserver started at http://127.11.93.129:33495/ using document root <none> and password file <none>
I20260809 02:23:13.171365 30954 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:13.171433 30954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:13.171592 30954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:13.172857 30954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "e48e7247265e4e80969898baf2ec9b65"
format_stamp: "Formatted at 2026-08-09 02:23:13 on dist-test-slave-w206"
server_key: "e32cab0872e6af794f3a30a680c62dce"
server_key_iv: "a685c7a9017a05cfd5de7c01f7c4e939"
server_key_version: "encryptionkey@0"
I20260809 02:23:13.173267 30954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "e48e7247265e4e80969898baf2ec9b65"
format_stamp: "Formatted at 2026-08-09 02:23:13 on dist-test-slave-w206"
server_key: "e32cab0872e6af794f3a30a680c62dce"
server_key_iv: "a685c7a9017a05cfd5de7c01f7c4e939"
server_key_version: "encryptionkey@0"
I20260809 02:23:13.175326 30954 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:23:13.176434 30969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:13.176581 30954 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:13.176664 30954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "e48e7247265e4e80969898baf2ec9b65"
format_stamp: "Formatted at 2026-08-09 02:23:13 on dist-test-slave-w206"
server_key: "e32cab0872e6af794f3a30a680c62dce"
server_key_iv: "a685c7a9017a05cfd5de7c01f7c4e939"
server_key_version: "encryptionkey@0"
I20260809 02:23:13.176740 30954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:13.203509 30954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:13.205875 30954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:13.206053 30954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:13.206310 30954 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:13.206637 30954 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:13.206691 30954 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:13.206736 30954 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:13.206763 30954 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:13.212921 30954 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:43579
I20260809 02:23:13.212963 31089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:43579 every 8 connection(s)
I20260809 02:23:13.213356 30954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
Aug 09 02:23:13 dist-test-slave-w206 krb5kdc[30836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242193, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:23:13.220613 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 30954
I20260809 02:23:13.220749 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:23:13.220956 11638 external_mini_cluster.cc:1428] Setting key c906812258cc855365101a8caaec07e4
I20260809 02:23:13.223714 30929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.214218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:41743 (local address 127.11.93.190:39653)
0809 02:23:13.214306 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:13.214309 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:13.214500 (+ 191us) server_negotiation.cc:407] Connection header received
0809 02:23:13.215094 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:13.215095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:13.215105 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:13.215157 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:13.216171 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.216669 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.217772 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.217971 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.218023 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.220572 (+ 2549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:13.220573 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:13.220574 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:13.220580 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:13.222135 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:13.222664 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:13.222665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:13.222665 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:13.222718 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:13.223052 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:13.223053 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:13.223057 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:13.223165 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:13.223224 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:13.223575 (+ 351us) server_negotiation.cc:299] Negotiation successful
0809 02:23:13.223648 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:23:13.224021 31092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.214162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:39653 (local address 127.11.93.129:41743)
0809 02:23:13.214369 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:13.214410 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:13.214926 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:13.215220 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:13.215223 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:13.215867 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:13.216081 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:13.216086 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.216765 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.216766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:13.217691 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:13.217693 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.218056 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.218057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:13.218168 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.218820 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:13.218832 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:13.220458 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:13.222217 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:13.222225 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:13.222228 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:13.222588 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:13.222784 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:13.222785 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:13.222785 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:13.222945 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:13.223233 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:13.223239 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:13.223427 (+ 188us) client_negotiation.cc:769] Sending connection context
0809 02:23:13.223537 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 02:23:13.223736 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":99,"threads_started":1}
I20260809 02:23:13.224495 31090 heartbeater.cc:347] Connected to a master server at 127.11.93.190:39653
I20260809 02:23:13.224613 31090 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:13.224874 31090 heartbeater.cc:511] Master 127.11.93.190:39653 requested a full tablet report, sending...
I20260809 02:23:13.225421 30884 ts_manager.cc:194] Registered new tserver with Master: e48e7247265e4e80969898baf2ec9b65 (127.11.93.129:43579)
I20260809 02:23:13.226065 30884 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:41743
WARNING: no policy specified for kudu/127.11.93.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
I20260809 02:23:13.247684 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:39653
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:46123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:13.331472 31095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:13.331682 31095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:13.331707 31095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:13.332886 31095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:13.332929 31095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:13.332955 31095 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:23:13.334344 31095 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:46123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:39653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31095
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:13.334532 31095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:13.334703 31095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:13.339648 31103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:13.339646 31100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:13.339666 31101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:13.339983 31095 server_base.cc:1034] running on GCE node
I20260809 02:23:13.340185 31095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:13.340418 31095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:13.341583 31095 hybrid_clock.cc:648] HybridClock initialized: now 1786242193341574 us; error 34 us; skew 500 ppm
Aug 09 02:23:13 dist-test-slave-w206 krb5kdc[30836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242193, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:13.344213 31095 init.cc:377] Logged in from keytab as kudu/127.11.93.130@KRBTEST.COM (short username kudu)
I20260809 02:23:13.344666 31095 webserver.cc:460] Webserver started at http://127.11.93.130:44927/ using document root <none> and password file <none>
I20260809 02:23:13.344902 31095 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:13.344972 31095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:13.345125 31095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:13.346215 31095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "677329fd09ea4b8482507f207366bb7d"
format_stamp: "Formatted at 2026-08-09 02:23:13 on dist-test-slave-w206"
server_key: "f6cf53d127c54d96f8f6e00bc810cf49"
server_key_iv: "f9533a390616598fd36abfd7a15ef45d"
server_key_version: "encryptionkey@0"
I20260809 02:23:13.346606 31095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "677329fd09ea4b8482507f207366bb7d"
format_stamp: "Formatted at 2026-08-09 02:23:13 on dist-test-slave-w206"
server_key: "f6cf53d127c54d96f8f6e00bc810cf49"
server_key_iv: "f9533a390616598fd36abfd7a15ef45d"
server_key_version: "encryptionkey@0"
I20260809 02:23:13.348591 31095 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260809 02:23:13.349393 31110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:13.349570 31095 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:13.349669 31095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "677329fd09ea4b8482507f207366bb7d"
format_stamp: "Formatted at 2026-08-09 02:23:13 on dist-test-slave-w206"
server_key: "f6cf53d127c54d96f8f6e00bc810cf49"
server_key_iv: "f9533a390616598fd36abfd7a15ef45d"
server_key_version: "encryptionkey@0"
I20260809 02:23:13.349758 31095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:13.372921 31095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:13.374936 31095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:13.375131 31095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:13.375387 31095 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:13.375705 31095 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:13.375762 31095 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:13.375804 31095 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:13.375849 31095 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:13.381775 31095 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:32869
I20260809 02:23:13.381887 31229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:32869 every 8 connection(s)
I20260809 02:23:13.382176 31095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:23:13.383162 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 31095
I20260809 02:23:13.383282 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:23:13.383476 11638 external_mini_cluster.cc:1428] Setting key dce579fb0def67bcd2dcca21e23ae563
Aug 09 02:23:13 dist-test-slave-w206 krb5kdc[30836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242193, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.93.131@KRBTEST.COM; defaulting to no policy
I20260809 02:23:13.392681 30929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.382968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:45039 (local address 127.11.93.190:39653)
0809 02:23:13.383055 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:13.383058 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:13.383256 (+ 198us) server_negotiation.cc:407] Connection header received
0809 02:23:13.383906 (+ 650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:13.383907 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:13.383919 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:13.383965 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:13.384956 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.385462 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.387017 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.387236 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.387301 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.389732 (+ 2431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:13.389743 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:13.389743 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:13.389751 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:13.391221 (+ 1470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:13.391677 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:13.391678 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:13.391678 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:13.391746 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:13.392005 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:13.392005 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:13.392006 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:13.392125 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:13.392204 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:13.392495 (+ 291us) server_negotiation.cc:299] Negotiation successful
0809 02:23:13.392585 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 02:23:13.392872 31233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.382931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:39653 (local address 127.11.93.130:45039)
0809 02:23:13.383110 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:13.383157 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:13.383815 (+ 658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:13.384034 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:13.384038 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:13.384661 (+ 623us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:13.384859 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:13.384864 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.385566 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.385567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:13.386875 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:13.386878 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.387324 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.387325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:13.387475 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.388023 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:13.388034 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:13.389631 (+ 1597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:13.391342 (+ 1711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:13.391348 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:13.391350 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:13.391578 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:13.391814 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:13.391815 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:13.391816 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:13.391929 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:13.392194 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:13.392212 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:13.392357 (+ 145us) client_negotiation.cc:769] Sending connection context
0809 02:23:13.392471 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 02:23:13.392636 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":107,"threads_started":1}
I20260809 02:23:13.393615 31230 heartbeater.cc:347] Connected to a master server at 127.11.93.190:39653
I20260809 02:23:13.393740 31230 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:13.393954 31230 heartbeater.cc:511] Master 127.11.93.190:39653 requested a full tablet report, sending...
I20260809 02:23:13.394428 30884 ts_manager.cc:194] Registered new tserver with Master: 677329fd09ea4b8482507f207366bb7d (127.11.93.130:32869)
I20260809 02:23:13.394809 30884 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:45039
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
I20260809 02:23:13.409977 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:39653
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:46123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:13.492956 31236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:13.493232 31236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:13.493275 31236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:13.494478 31236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:13.494544 31236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:13.494589 31236 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:23:13.496124 31236 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:46123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:39653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:13.496390 31236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:13.496622 31236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:13.501943 31242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:13.502000 31241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:13.501950 31244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:13.501966 31236 server_base.cc:1034] running on GCE node
I20260809 02:23:13.502389 31236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:13.502643 31236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:13.503826 31236 hybrid_clock.cc:648] HybridClock initialized: now 1786242193503818 us; error 37 us; skew 500 ppm
Aug 09 02:23:13 dist-test-slave-w206 krb5kdc[30836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242193, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:13.506441 31236 init.cc:377] Logged in from keytab as kudu/127.11.93.131@KRBTEST.COM (short username kudu)
I20260809 02:23:13.506894 31236 webserver.cc:460] Webserver started at http://127.11.93.131:34985/ using document root <none> and password file <none>
I20260809 02:23:13.507138 31236 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:13.507207 31236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:13.507364 31236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:13.508404 31236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "92ff1e99ae5c46729c6d556becc3f8ad"
format_stamp: "Formatted at 2026-08-09 02:23:13 on dist-test-slave-w206"
server_key: "70f53eb0c9a9a242b1a777977417a868"
server_key_iv: "91dfe12592268c4a194d4e115aefc4f8"
server_key_version: "encryptionkey@0"
I20260809 02:23:13.508772 31236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "92ff1e99ae5c46729c6d556becc3f8ad"
format_stamp: "Formatted at 2026-08-09 02:23:13 on dist-test-slave-w206"
server_key: "70f53eb0c9a9a242b1a777977417a868"
server_key_iv: "91dfe12592268c4a194d4e115aefc4f8"
server_key_version: "encryptionkey@0"
I20260809 02:23:13.510079 31236 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:23:13.510829 31254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:13.511075 31236 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:13.511178 31236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "92ff1e99ae5c46729c6d556becc3f8ad"
format_stamp: "Formatted at 2026-08-09 02:23:13 on dist-test-slave-w206"
server_key: "70f53eb0c9a9a242b1a777977417a868"
server_key_iv: "91dfe12592268c4a194d4e115aefc4f8"
server_key_version: "encryptionkey@0"
I20260809 02:23:13.511277 31236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:13.525790 31236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:13.528283 31236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:13.528460 31236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:13.528714 31236 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:13.529043 31236 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:13.529098 31236 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:13.529141 31236 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:13.529170 31236 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:13.535257 31236 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:41323
I20260809 02:23:13.535377 31378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:41323 every 8 connection(s)
I20260809 02:23:13.535686 31236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
Aug 09 02:23:13 dist-test-slave-w206 krb5kdc[30836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242193, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:23:13.544514 30929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.536422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:38365 (local address 127.11.93.190:39653)
0809 02:23:13.536472 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:13.536474 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:13.536681 (+ 207us) server_negotiation.cc:407] Connection header received
0809 02:23:13.537148 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:13.537149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:13.537159 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:13.537208 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:13.538120 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.538614 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.539634 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.539817 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.539871 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.541945 (+ 2074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:13.541947 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:13.541947 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:13.541954 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:13.543183 (+ 1229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:13.543548 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:13.543549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:13.543549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:13.543600 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:13.543928 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:13.543929 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:13.543929 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:13.544037 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:13.544093 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:13.544383 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 02:23:13.544446 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 02:23:13.544755 31382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.536412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:39653 (local address 127.11.93.131:38365)
0809 02:23:13.536561 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:13.536597 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:13.537061 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:13.537264 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:13.537268 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:13.537849 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:13.538040 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:13.538044 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.538696 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.538696 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:13.539559 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:13.539562 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.539893 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.539893 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:13.540000 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.540434 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:13.540442 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:13.541848 (+ 1406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:13.543253 (+ 1405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:13.543259 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:13.543260 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:13.543481 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:13.543700 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:13.543701 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:13.543702 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:13.543853 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:13.544117 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:13.544123 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:13.544255 (+ 132us) client_negotiation.cc:769] Sending connection context
0809 02:23:13.544355 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 02:23:13.544478 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":83,"threads_started":1}
I20260809 02:23:13.545368 31380 heartbeater.cc:347] Connected to a master server at 127.11.93.190:39653
I20260809 02:23:13.545454 31380 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:13.545598 31380 heartbeater.cc:511] Master 127.11.93.190:39653 requested a full tablet report, sending...
I20260809 02:23:13.545797 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 31236
I20260809 02:23:13.545919 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:23:13.546036 30884 ts_manager.cc:194] Registered new tserver with Master: 92ff1e99ae5c46729c6d556becc3f8ad (127.11.93.131:41323)
I20260809 02:23:13.546125 11638 external_mini_cluster.cc:1428] Setting key 5adf149ae38388689b8d5dbd5e3d8242
I20260809 02:23:13.546492 30884 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:38365
I20260809 02:23:13.547102 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:23:13.554637 30929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.548451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39960 (local address 127.11.93.190:39653)
0809 02:23:13.548500 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:13.548502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:13.548597 (+ 95us) server_negotiation.cc:407] Connection header received
0809 02:23:13.548642 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:13.548642 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:13.548651 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:13.548697 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:13.549210 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.549658 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.550373 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.550547 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.550595 (+ 48us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.551978 (+ 1383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:13.551979 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:13.551979 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:13.551985 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:13.553275 (+ 1290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:13.553813 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:13.553814 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:13.553814 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:13.553872 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:13.554153 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:13.554154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:13.554154 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:13.554289 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:13.554374 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:13.554512 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 02:23:13.554573 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 02:23:13.556465 30884 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39960:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:23:13.558111 30884 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:23:13.565274 31395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.560751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37132 (local address 127.11.93.131:41323)
0809 02:23:13.561224 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:13.561228 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:13.561239 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:23:13.561367 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:13.561370 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:13.561410 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:13.561493 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:13.561742 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.562498 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.563986 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.564804 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.564893 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.564957 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:13.565119 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 02:23:13.565179 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":87,"threads_started":1}
I20260809 02:23:13.565260 31393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.560864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:43579 (local address 127.0.0.1:35256)
0809 02:23:13.561138 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:13.561150 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:13.561209 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:13.561545 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:13.561545 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:13.561547 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:13.561585 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:13.561587 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.562836 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.562837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:13.563980 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:13.563982 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.564904 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.564906 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:13.564992 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.565010 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 02:23:13.565088 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 02:23:13.565154 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":29,"thread_start_us":69,"threads_started":1}
I20260809 02:23:13.565531 31397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.561095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35256 (local address 127.11.93.129:43579)
0809 02:23:13.561303 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:13.561306 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:13.561315 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:23:13.561370 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:13.561373 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:13.561389 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:13.561463 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:13.561663 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.562739 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.564058 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.564819 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.564893 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.564956 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:13.565402 (+ 446us) server_negotiation.cc:299] Negotiation successful
0809 02:23:13.565448 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":102,"threads_started":1}
I20260809 02:23:13.565260 31396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.560636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:41323 (local address 127.0.0.1:37132)
0809 02:23:13.560977 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:13.560997 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:13.561053 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:13.561585 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:13.561586 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:13.561589 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:13.561638 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:13.561640 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.562614 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.562615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:13.563893 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:13.563895 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.564907 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.564907 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:13.564992 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.565010 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 02:23:13.565087 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 02:23:13.565154 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"mutex_wait_us":1,"thread_start_us":110,"threads_started":1}
I20260809 02:23:13.566497 31307 tablet_service.cc:1467] Processing CreateTablet for tablet d815076f00df4f6bb7ae8126c286ec58 (DEFAULT_TABLE table=test-table [id=064d52827c1e4ed5ad918743393e437d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:13.566499 31020 tablet_service.cc:1467] Processing CreateTablet for tablet d815076f00df4f6bb7ae8126c286ec58 (DEFAULT_TABLE table=test-table [id=064d52827c1e4ed5ad918743393e437d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:13.566856 31307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d815076f00df4f6bb7ae8126c286ec58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:13.566871 31020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d815076f00df4f6bb7ae8126c286ec58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:13.569633 31398 tablet_bootstrap.cc:492] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad: Bootstrap starting.
I20260809 02:23:13.569885 31399 tablet_bootstrap.cc:492] T d815076f00df4f6bb7ae8126c286ec58 P e48e7247265e4e80969898baf2ec9b65: Bootstrap starting.
I20260809 02:23:13.570029 31392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.560630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:32869 (local address 127.0.0.1:44228)
0809 02:23:13.560795 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:13.560835 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:13.560906 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:13.561285 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:13.561289 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:13.561291 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:13.561370 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:13.561371 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.562734 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.562735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:13.563978 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:13.563981 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.566018 (+ 2037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.566019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:13.566090 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.566095 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:23:13.569855 (+ 3760us) client_negotiation.cc:240] Negotiation successful
0809 02:23:13.569917 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":6,"thread_start_us":59,"threads_started":1}
I20260809 02:23:13.570427 31394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.560730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44228 (local address 127.11.93.130:32869)
0809 02:23:13.560936 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:13.560941 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:13.560951 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:23:13.560996 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:13.560998 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:13.561013 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:13.561082 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:13.561466 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.562607 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.565003 (+ 2396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.565850 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.565921 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.565981 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:13.570249 (+ 4268us) server_negotiation.cc:299] Negotiation successful
0809 02:23:13.570309 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":78,"threads_started":1}
I20260809 02:23:13.570429 31398 tablet_bootstrap.cc:654] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:13.570559 31399 tablet_bootstrap.cc:654] T d815076f00df4f6bb7ae8126c286ec58 P e48e7247265e4e80969898baf2ec9b65: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:13.571131 31398 log.cc:824] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:13.571180 31399 log.cc:824] T d815076f00df4f6bb7ae8126c286ec58 P e48e7247265e4e80969898baf2ec9b65: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:13.571192 31159 tablet_service.cc:1467] Processing CreateTablet for tablet d815076f00df4f6bb7ae8126c286ec58 (DEFAULT_TABLE table=test-table [id=064d52827c1e4ed5ad918743393e437d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:13.571552 31159 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d815076f00df4f6bb7ae8126c286ec58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:13.571923 31399 tablet_bootstrap.cc:492] T d815076f00df4f6bb7ae8126c286ec58 P e48e7247265e4e80969898baf2ec9b65: No bootstrap required, opened a new log
I20260809 02:23:13.572000 31399 ts_tablet_manager.cc:1397] T d815076f00df4f6bb7ae8126c286ec58 P e48e7247265e4e80969898baf2ec9b65: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260809 02:23:13.572034 31398 tablet_bootstrap.cc:492] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad: No bootstrap required, opened a new log
I20260809 02:23:13.572103 31398 ts_tablet_manager.cc:1397] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260809 02:23:13.573743 31398 raft_consensus.cc:348] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92ff1e99ae5c46729c6d556becc3f8ad" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 41323 } } peers { permanent_uuid: "677329fd09ea4b8482507f207366bb7d" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 32869 } } peers { permanent_uuid: "e48e7247265e4e80969898baf2ec9b65" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43579 } }
I20260809 02:23:13.573932 31398 raft_consensus.cc:374] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:13.573982 31398 raft_consensus.cc:729] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92ff1e99ae5c46729c6d556becc3f8ad, State: Initialized, Role: FOLLOWER
I20260809 02:23:13.574119 31398 consensus_queue.cc:260] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92ff1e99ae5c46729c6d556becc3f8ad" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 41323 } } peers { permanent_uuid: "677329fd09ea4b8482507f207366bb7d" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 32869 } } peers { permanent_uuid: "e48e7247265e4e80969898baf2ec9b65" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43579 } }
I20260809 02:23:13.574043 31399 raft_consensus.cc:348] T d815076f00df4f6bb7ae8126c286ec58 P e48e7247265e4e80969898baf2ec9b65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92ff1e99ae5c46729c6d556becc3f8ad" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 41323 } } peers { permanent_uuid: "677329fd09ea4b8482507f207366bb7d" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 32869 } } peers { permanent_uuid: "e48e7247265e4e80969898baf2ec9b65" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43579 } }
I20260809 02:23:13.574225 31399 raft_consensus.cc:374] T d815076f00df4f6bb7ae8126c286ec58 P e48e7247265e4e80969898baf2ec9b65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:13.574276 31399 raft_consensus.cc:729] T d815076f00df4f6bb7ae8126c286ec58 P e48e7247265e4e80969898baf2ec9b65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e48e7247265e4e80969898baf2ec9b65, State: Initialized, Role: FOLLOWER
I20260809 02:23:13.574380 31399 consensus_queue.cc:260] T d815076f00df4f6bb7ae8126c286ec58 P e48e7247265e4e80969898baf2ec9b65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92ff1e99ae5c46729c6d556becc3f8ad" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 41323 } } peers { permanent_uuid: "677329fd09ea4b8482507f207366bb7d" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 32869 } } peers { permanent_uuid: "e48e7247265e4e80969898baf2ec9b65" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43579 } }
I20260809 02:23:13.574440 31398 ts_tablet_manager.cc:1428] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260809 02:23:13.574579 31380 heartbeater.cc:503] Master 127.11.93.190:39653 was elected leader, sending a full tablet report...
I20260809 02:23:13.574673 31399 ts_tablet_manager.cc:1428] T d815076f00df4f6bb7ae8126c286ec58 P e48e7247265e4e80969898baf2ec9b65: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 02:23:13.574877 31090 heartbeater.cc:503] Master 127.11.93.190:39653 was elected leader, sending a full tablet report...
I20260809 02:23:13.574919 31404 tablet_bootstrap.cc:492] T d815076f00df4f6bb7ae8126c286ec58 P 677329fd09ea4b8482507f207366bb7d: Bootstrap starting.
I20260809 02:23:13.575611 31404 tablet_bootstrap.cc:654] T d815076f00df4f6bb7ae8126c286ec58 P 677329fd09ea4b8482507f207366bb7d: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:13.576076 31404 log.cc:824] T d815076f00df4f6bb7ae8126c286ec58 P 677329fd09ea4b8482507f207366bb7d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:13.576869 31404 tablet_bootstrap.cc:492] T d815076f00df4f6bb7ae8126c286ec58 P 677329fd09ea4b8482507f207366bb7d: No bootstrap required, opened a new log
I20260809 02:23:13.576938 31404 ts_tablet_manager.cc:1397] T d815076f00df4f6bb7ae8126c286ec58 P 677329fd09ea4b8482507f207366bb7d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 02:23:13.578213 31404 raft_consensus.cc:348] T d815076f00df4f6bb7ae8126c286ec58 P 677329fd09ea4b8482507f207366bb7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92ff1e99ae5c46729c6d556becc3f8ad" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 41323 } } peers { permanent_uuid: "677329fd09ea4b8482507f207366bb7d" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 32869 } } peers { permanent_uuid: "e48e7247265e4e80969898baf2ec9b65" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43579 } }
I20260809 02:23:13.578337 31404 raft_consensus.cc:374] T d815076f00df4f6bb7ae8126c286ec58 P 677329fd09ea4b8482507f207366bb7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:13.578359 31404 raft_consensus.cc:729] T d815076f00df4f6bb7ae8126c286ec58 P 677329fd09ea4b8482507f207366bb7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 677329fd09ea4b8482507f207366bb7d, State: Initialized, Role: FOLLOWER
I20260809 02:23:13.578474 31404 consensus_queue.cc:260] T d815076f00df4f6bb7ae8126c286ec58 P 677329fd09ea4b8482507f207366bb7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92ff1e99ae5c46729c6d556becc3f8ad" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 41323 } } peers { permanent_uuid: "677329fd09ea4b8482507f207366bb7d" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 32869 } } peers { permanent_uuid: "e48e7247265e4e80969898baf2ec9b65" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43579 } }
I20260809 02:23:13.578745 31404 ts_tablet_manager.cc:1428] T d815076f00df4f6bb7ae8126c286ec58 P 677329fd09ea4b8482507f207366bb7d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 02:23:13.578764 31230 heartbeater.cc:503] Master 127.11.93.190:39653 was elected leader, sending a full tablet report...
I20260809 02:23:13.584406 31402 raft_consensus.cc:482] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:23:13.584492 31402 raft_consensus.cc:504] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92ff1e99ae5c46729c6d556becc3f8ad" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 41323 } } peers { permanent_uuid: "677329fd09ea4b8482507f207366bb7d" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 32869 } } peers { permanent_uuid: "e48e7247265e4e80969898baf2ec9b65" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43579 } }
I20260809 02:23:13.584870 31402 leader_election.cc:288] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 677329fd09ea4b8482507f207366bb7d (127.11.93.130:32869), e48e7247265e4e80969898baf2ec9b65 (127.11.93.129:43579)
I20260809 02:23:13.588639 31394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.585053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:45513 (local address 127.11.93.130:32869)
0809 02:23:13.585098 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:13.585100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:13.585111 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:23:13.585185 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:13.585186 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:13.585196 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:13.585262 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:13.585410 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.586145 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.587614 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.588187 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.588265 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.588273 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:13.588537 (+ 264us) server_negotiation.cc:299] Negotiation successful
0809 02:23:13.588572 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 02:23:13.588641 31382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.585006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:32869 (local address 127.11.93.131:45513)
0809 02:23:13.585062 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:13.585074 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:13.585113 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:13.585261 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:13.585261 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:13.585263 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:13.585341 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:13.585342 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.586231 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.586232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:13.587523 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:13.587525 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.588356 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.588357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:13.588445 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.588451 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 02:23:13.588531 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 02:23:13.588574 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":60}
I20260809 02:23:13.589015 31408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.585033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:43579 (local address 127.11.93.131:37821)
0809 02:23:13.585259 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:13.585270 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:13.585327 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:13.585457 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:13.585458 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:13.585459 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:13.585506 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:13.585507 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.586325 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.586325 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:13.587523 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:13.587526 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.588741 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.588742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:13.588842 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.588847 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:23:13.588903 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 02:23:13.588940 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":5,"thread_start_us":104,"threads_started":1}
I20260809 02:23:13.589007 31397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.585082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:37821 (local address 127.11.93.129:43579)
0809 02:23:13.585204 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:13.585207 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:13.585339 (+ 132us) server_negotiation.cc:407] Connection header received
0809 02:23:13.585393 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:13.585394 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:13.585403 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:13.585456 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:13.585564 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.586256 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.587614 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.588187 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.588265 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.588273 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:13.588909 (+ 636us) server_negotiation.cc:299] Negotiation successful
0809 02:23:13.588949 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260809 02:23:13.588967 31181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d815076f00df4f6bb7ae8126c286ec58" candidate_uuid: "92ff1e99ae5c46729c6d556becc3f8ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "677329fd09ea4b8482507f207366bb7d" is_pre_election: true
I20260809 02:23:13.589103 31181 raft_consensus.cc:2454] T d815076f00df4f6bb7ae8126c286ec58 P 677329fd09ea4b8482507f207366bb7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92ff1e99ae5c46729c6d556becc3f8ad in term 0.
I20260809 02:23:13.589346 31257 leader_election.cc:302] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 677329fd09ea4b8482507f207366bb7d, 92ff1e99ae5c46729c6d556becc3f8ad; no voters:
I20260809 02:23:13.589378 31041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d815076f00df4f6bb7ae8126c286ec58" candidate_uuid: "92ff1e99ae5c46729c6d556becc3f8ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e48e7247265e4e80969898baf2ec9b65" is_pre_election: true
I20260809 02:23:13.589484 31402 raft_consensus.cc:2781] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:23:13.589543 31402 raft_consensus.cc:482] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:23:13.589529 31041 raft_consensus.cc:2454] T d815076f00df4f6bb7ae8126c286ec58 P e48e7247265e4e80969898baf2ec9b65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92ff1e99ae5c46729c6d556becc3f8ad in term 0.
I20260809 02:23:13.589579 31402 raft_consensus.cc:3037] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:13.590287 31402 raft_consensus.cc:504] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92ff1e99ae5c46729c6d556becc3f8ad" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 41323 } } peers { permanent_uuid: "677329fd09ea4b8482507f207366bb7d" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 32869 } } peers { permanent_uuid: "e48e7247265e4e80969898baf2ec9b65" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43579 } }
I20260809 02:23:13.590433 31402 leader_election.cc:288] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad [CANDIDATE]: Term 1 election: Requested vote from peers 677329fd09ea4b8482507f207366bb7d (127.11.93.130:32869), e48e7247265e4e80969898baf2ec9b65 (127.11.93.129:43579)
I20260809 02:23:13.590560 31181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d815076f00df4f6bb7ae8126c286ec58" candidate_uuid: "92ff1e99ae5c46729c6d556becc3f8ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "677329fd09ea4b8482507f207366bb7d"
I20260809 02:23:13.590615 31041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d815076f00df4f6bb7ae8126c286ec58" candidate_uuid: "92ff1e99ae5c46729c6d556becc3f8ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e48e7247265e4e80969898baf2ec9b65"
I20260809 02:23:13.590664 31181 raft_consensus.cc:3037] T d815076f00df4f6bb7ae8126c286ec58 P 677329fd09ea4b8482507f207366bb7d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:13.590701 31041 raft_consensus.cc:3037] T d815076f00df4f6bb7ae8126c286ec58 P e48e7247265e4e80969898baf2ec9b65 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:13.591475 31181 raft_consensus.cc:2454] T d815076f00df4f6bb7ae8126c286ec58 P 677329fd09ea4b8482507f207366bb7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92ff1e99ae5c46729c6d556becc3f8ad in term 1.
I20260809 02:23:13.591485 31041 raft_consensus.cc:2454] T d815076f00df4f6bb7ae8126c286ec58 P e48e7247265e4e80969898baf2ec9b65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92ff1e99ae5c46729c6d556becc3f8ad in term 1.
I20260809 02:23:13.591681 31258 leader_election.cc:302] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92ff1e99ae5c46729c6d556becc3f8ad, e48e7247265e4e80969898baf2ec9b65; no voters:
I20260809 02:23:13.591804 31402 raft_consensus.cc:2781] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:13.591950 31402 raft_consensus.cc:686] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad [term 1 LEADER]: Becoming Leader. State: Replica: 92ff1e99ae5c46729c6d556becc3f8ad, State: Running, Role: LEADER
I20260809 02:23:13.592042 31402 consensus_queue.cc:237] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92ff1e99ae5c46729c6d556becc3f8ad" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 41323 } } peers { permanent_uuid: "677329fd09ea4b8482507f207366bb7d" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 32869 } } peers { permanent_uuid: "e48e7247265e4e80969898baf2ec9b65" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43579 } }
I20260809 02:23:13.592872 30884 catalog_manager.cc:5495] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad reported cstate change: term changed from 0 to 1, leader changed from <none> to 92ff1e99ae5c46729c6d556becc3f8ad (127.11.93.131). New cstate: current_term: 1 leader_uuid: "92ff1e99ae5c46729c6d556becc3f8ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92ff1e99ae5c46729c6d556becc3f8ad" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 41323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "677329fd09ea4b8482507f207366bb7d" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 32869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e48e7247265e4e80969898baf2ec9b65" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43579 } health_report { overall_health: UNKNOWN } } }
I20260809 02:23:13.601050 31395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.598565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37136 (local address 127.11.93.131:41323)
0809 02:23:13.598623 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:13.598625 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:13.598634 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:23:13.598744 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:13.598745 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:13.598765 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:13.598848 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:13.599009 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.599481 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.600272 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.600471 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.600544 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.600725 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:13.600815 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:13.600922 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:13.600960 (+ 38us) server_negotiation.cc:299] Negotiation successful
0809 02:23:13.600970 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 02:23:13.602758 31181 raft_consensus.cc:1261] T d815076f00df4f6bb7ae8126c286ec58 P 677329fd09ea4b8482507f207366bb7d [term 1 FOLLOWER]: Refusing update from remote peer 92ff1e99ae5c46729c6d556becc3f8ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:13.602797 31041 raft_consensus.cc:1261] T d815076f00df4f6bb7ae8126c286ec58 P e48e7247265e4e80969898baf2ec9b65 [term 1 FOLLOWER]: Refusing update from remote peer 92ff1e99ae5c46729c6d556becc3f8ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:13.603237 31409 consensus_queue.cc:1035] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "e48e7247265e4e80969898baf2ec9b65" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:13.603417 31402 consensus_queue.cc:1035] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "677329fd09ea4b8482507f207366bb7d" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 32869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:13.606591 31412 mvcc.cc:205] Tried to move back new op lower bound from 7316448024994545664 to 7316448024953737216. Current Snapshot: MvccSnapshot[applied={T|T < 7316448024994545664 or (T in {7316448024994545664})}]
I20260809 02:23:13.606737 31414 mvcc.cc:205] Tried to move back new op lower bound from 7316448024994545664 to 7316448024953737216. Current Snapshot: MvccSnapshot[applied={T|T < 7316448024994545664}]
I20260809 02:23:13.606874 31413 mvcc.cc:205] Tried to move back new op lower bound from 7316448024994545664 to 7316448024953737216. Current Snapshot: MvccSnapshot[applied={T|T < 7316448024994545664 or (T in {7316448024994545664})}]
I20260809 02:23:13.608253 30884 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39960:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:23:13.608356 30884 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39960:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:23:13.609114 30884 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 996b8d50169244f1a215177992e003d5: Sending DeleteTablet for 3 replicas of tablet d815076f00df4f6bb7ae8126c286ec58
I20260809 02:23:13.609426 31307 tablet_service.cc:1514] Processing DeleteTablet for tablet d815076f00df4f6bb7ae8126c286ec58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:13 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:37132
I20260809 02:23:13.609570 31159 tablet_service.cc:1514] Processing DeleteTablet for tablet d815076f00df4f6bb7ae8126c286ec58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:13 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:44228
I20260809 02:23:13.609669 31020 tablet_service.cc:1514] Processing DeleteTablet for tablet d815076f00df4f6bb7ae8126c286ec58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:13 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:35256
I20260809 02:23:13.609848 31425 tablet_replica.cc:330] T d815076f00df4f6bb7ae8126c286ec58 P 677329fd09ea4b8482507f207366bb7d: stopping tablet replica
I20260809 02:23:13.609860 31426 tablet_replica.cc:330] T d815076f00df4f6bb7ae8126c286ec58 P e48e7247265e4e80969898baf2ec9b65: stopping tablet replica
I20260809 02:23:13.609951 31426 raft_consensus.cc:2229] T d815076f00df4f6bb7ae8126c286ec58 P e48e7247265e4e80969898baf2ec9b65 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:23:13.610041 31425 raft_consensus.cc:2229] T d815076f00df4f6bb7ae8126c286ec58 P 677329fd09ea4b8482507f207366bb7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:23:13.610055 31426 raft_consensus.cc:2258] T d815076f00df4f6bb7ae8126c286ec58 P e48e7247265e4e80969898baf2ec9b65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:23:13.610144 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 30954
I20260809 02:23:13.610244 31425 raft_consensus.cc:2258] T d815076f00df4f6bb7ae8126c286ec58 P 677329fd09ea4b8482507f207366bb7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:23:13.611768 31425 ts_tablet_manager.cc:1905] T d815076f00df4f6bb7ae8126c286ec58 P 677329fd09ea4b8482507f207366bb7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:23:13.613858 31425 ts_tablet_manager.cc:1918] T d815076f00df4f6bb7ae8126c286ec58 P 677329fd09ea4b8482507f207366bb7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:23:13.613937 31425 log.cc:1196] T d815076f00df4f6bb7ae8126c286ec58 P 677329fd09ea4b8482507f207366bb7d: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/d815076f00df4f6bb7ae8126c286ec58
I20260809 02:23:13.614217 31425 ts_tablet_manager.cc:1939] T d815076f00df4f6bb7ae8126c286ec58 P 677329fd09ea4b8482507f207366bb7d: Deleting consensus metadata
I20260809 02:23:13.614691 30870 catalog_manager.cc:4841] TS 677329fd09ea4b8482507f207366bb7d (127.11.93.130:32869): tablet d815076f00df4f6bb7ae8126c286ec58 (table test-table [id=064d52827c1e4ed5ad918743393e437d]) successfully deleted
W20260809 02:23:13.617955 30871 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.93.129:43579 (error 108)
I20260809 02:23:13.618103 31424 tablet_replica.cc:330] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad: stopping tablet replica
I20260809 02:23:13.618216 31424 raft_consensus.cc:2229] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:23:13.618321 31424 raft_consensus.cc:2258] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:23:13.618562 31392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.618435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:43579 (local address 127.0.0.1:35266)
0809 02:23:13.618488 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:13.618522 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.129:43579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260809 02:23:13.618691 30871 catalog_manager.cc:4584] TS e48e7247265e4e80969898baf2ec9b65 (127.11.93.129:43579): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d815076f00df4f6bb7ae8126c286ec58: Network error: Client connection negotiation failed: client connection to 127.11.93.129:43579: connect: Connection refused (error 111)
I20260809 02:23:13.618767 31424 ts_tablet_manager.cc:1905] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:23:13.619064 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 31095
I20260809 02:23:13.628955 31424 ts_tablet_manager.cc:1918] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:23:13.629077 31424 log.cc:1196] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/d815076f00df4f6bb7ae8126c286ec58
I20260809 02:23:13.629418 31424 ts_tablet_manager.cc:1939] T d815076f00df4f6bb7ae8126c286ec58 P 92ff1e99ae5c46729c6d556becc3f8ad: Deleting consensus metadata
I20260809 02:23:13.629921 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 31236
I20260809 02:23:13.629921 30871 catalog_manager.cc:4841] TS 92ff1e99ae5c46729c6d556becc3f8ad (127.11.93.131:41323): tablet d815076f00df4f6bb7ae8126c286ec58 (table test-table [id=064d52827c1e4ed5ad918743393e437d]) successfully deleted
I20260809 02:23:13.638108 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 30851
2026-08-09T02:23:13Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (1956 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-09T02:23:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:13Z Disabled control of system clock
I20260809 02:23:13.668453 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:39751
--webserver_interface=127.11.93.190
--webserver_port=0
--builtin_ntp_servers=127.11.93.148:35843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:39751
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:23:13.750829 31432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:13.751073 31432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:13.751096 31432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:13.752185 31432 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:13.752218 31432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:13.752231 31432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:13.752244 31432 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:13.752256 31432 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:13.753530 31432 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:39751
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:39751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31432
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:13.753755 31432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:13.753993 31432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:13.759163 31441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:13.759152 31444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:13.759171 31442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:13.759181 31432 server_base.cc:1034] running on GCE node
I20260809 02:23:13.759601 31432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:13.759894 31432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:13.761088 31432 hybrid_clock.cc:648] HybridClock initialized: now 1786242193761067 us; error 41 us; skew 500 ppm
I20260809 02:23:13.762413 31432 webserver.cc:460] Webserver started at http://127.11.93.190:38631/ using document root <none> and password file <none>
I20260809 02:23:13.762666 31432 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:13.762738 31432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:13.762936 31432 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:13.764058 31432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "1f471b3c44164ca28cca34921e5dfd3d"
format_stamp: "Formatted at 2026-08-09 02:23:13 on dist-test-slave-w206"
server_key: "3059b3faab5ddca8569ad77f8a519599"
server_key_iv: "ea808fa7963a557edb0163d2e8f311b4"
server_key_version: "encryptionkey@0"
I20260809 02:23:13.764429 31432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "1f471b3c44164ca28cca34921e5dfd3d"
format_stamp: "Formatted at 2026-08-09 02:23:13 on dist-test-slave-w206"
server_key: "3059b3faab5ddca8569ad77f8a519599"
server_key_iv: "ea808fa7963a557edb0163d2e8f311b4"
server_key_version: "encryptionkey@0"
I20260809 02:23:13.765796 31432 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:23:13.766595 31450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:13.766790 31432 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:13.766906 31432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "1f471b3c44164ca28cca34921e5dfd3d"
format_stamp: "Formatted at 2026-08-09 02:23:13 on dist-test-slave-w206"
server_key: "3059b3faab5ddca8569ad77f8a519599"
server_key_iv: "ea808fa7963a557edb0163d2e8f311b4"
server_key_version: "encryptionkey@0"
I20260809 02:23:13.767001 31432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:13.791843 31432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:13.792227 31432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:13.792402 31432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:13.796698 31432 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:39751
I20260809 02:23:13.796741 31504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:39751 every 8 connection(s)
I20260809 02:23:13.797123 31432 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:13.798173 31505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:13.800597 31505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d: Bootstrap starting.
I20260809 02:23:13.801183 31505 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:13.801484 31505 log.cc:824] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:13.802152 31505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d: No bootstrap required, opened a new log
I20260809 02:23:13.803462 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 31432
I20260809 02:23:13.803555 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:13.803782 11638 external_mini_cluster.cc:1428] Setting key 1a7399d08177f6827cb0fd55a07bbfb3
I20260809 02:23:13.804133 31505 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f471b3c44164ca28cca34921e5dfd3d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 39751 } }
I20260809 02:23:13.804329 31505 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:13.804373 31505 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f471b3c44164ca28cca34921e5dfd3d, State: Initialized, Role: FOLLOWER
I20260809 02:23:13.804518 31505 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f471b3c44164ca28cca34921e5dfd3d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 39751 } }
I20260809 02:23:13.804636 31505 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:13.804670 31505 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:13.804750 31505 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:13.805258 31505 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f471b3c44164ca28cca34921e5dfd3d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 39751 } }
I20260809 02:23:13.805378 31505 leader_election.cc:302] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f471b3c44164ca28cca34921e5dfd3d; no voters:
I20260809 02:23:13.805578 31505 leader_election.cc:288] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:13.805624 31510 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:13.805742 31510 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d [term 1 LEADER]: Becoming Leader. State: Replica: 1f471b3c44164ca28cca34921e5dfd3d, State: Running, Role: LEADER
I20260809 02:23:13.805869 31505 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:13.805903 31510 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f471b3c44164ca28cca34921e5dfd3d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 39751 } }
I20260809 02:23:13.806332 31510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f471b3c44164ca28cca34921e5dfd3d. Latest consensus state: current_term: 1 leader_uuid: "1f471b3c44164ca28cca34921e5dfd3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f471b3c44164ca28cca34921e5dfd3d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 39751 } } }
I20260809 02:23:13.806340 31511 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f471b3c44164ca28cca34921e5dfd3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f471b3c44164ca28cca34921e5dfd3d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 39751 } } }
I20260809 02:23:13.806529 31510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:13.806540 31511 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:13.806838 31519 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:13.807457 31519 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:13.810331 31509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.804477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58186 (local address 127.11.93.190:39751)
0809 02:23:13.804722 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:13.804731 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:13.804764 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:23:13.804890 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:13.804895 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:13.804947 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:13.805093 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:13.805311 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.807075 (+ 1764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.808221 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.808793 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.808924 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.809632 (+ 708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:13.809635 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:13.809636 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:13.809839 (+ 203us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:13.809893 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:13.809908 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:13.809981 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:13.810046 (+ 65us) server_negotiation.cc:299] Negotiation successful
0809 02:23:13.810122 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":94,"threads_started":1}
I20260809 02:23:13.811952 31519 catalog_manager.cc:1347] Generated new cluster ID: dc48d88b36a646a2ad7e915b82a22195
I20260809 02:23:13.812011 31519 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:13.830717 31519 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:13.831457 31519 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:13.836069 31519 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d: Generated new TSK 0
I20260809 02:23:13.836266 31519 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:13.838848 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:39751
--builtin_ntp_servers=127.11.93.148:35843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:23:13.922187 31532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:13.922433 31532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:13.922472 31532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:13.923712 31532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:13.923787 31532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:13.923835 31532 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:23:13.925233 31532 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:39751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:13.925479 31532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:13.925781 31532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:13.931576 31541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:13.931588 31539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:13.931576 31538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:13.931964 31532 server_base.cc:1034] running on GCE node
I20260809 02:23:13.932178 31532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:13.932461 31532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:13.933631 31532 hybrid_clock.cc:648] HybridClock initialized: now 1786242193933618 us; error 43 us; skew 500 ppm
I20260809 02:23:13.934965 31532 webserver.cc:460] Webserver started at http://127.11.93.129:44183/ using document root <none> and password file <none>
I20260809 02:23:13.935312 31532 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:13.935390 31532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:13.935545 31532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:13.936661 31532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "6fe44f99b015432e92d4dc488f6c00c0"
format_stamp: "Formatted at 2026-08-09 02:23:13 on dist-test-slave-w206"
server_key: "2510b64ab711259abbe5cc955521af9a"
server_key_iv: "edba0c279ce9aba7bfadfc3c47525e3a"
server_key_version: "encryptionkey@0"
I20260809 02:23:13.937036 31532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "6fe44f99b015432e92d4dc488f6c00c0"
format_stamp: "Formatted at 2026-08-09 02:23:13 on dist-test-slave-w206"
server_key: "2510b64ab711259abbe5cc955521af9a"
server_key_iv: "edba0c279ce9aba7bfadfc3c47525e3a"
server_key_version: "encryptionkey@0"
I20260809 02:23:13.938382 31532 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260809 02:23:13.939244 31547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:13.939429 31532 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:13.939541 31532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "6fe44f99b015432e92d4dc488f6c00c0"
format_stamp: "Formatted at 2026-08-09 02:23:13 on dist-test-slave-w206"
server_key: "2510b64ab711259abbe5cc955521af9a"
server_key_iv: "edba0c279ce9aba7bfadfc3c47525e3a"
server_key_version: "encryptionkey@0"
I20260809 02:23:13.939625 31532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:13.980646 31532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:13.981015 31532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:13.981194 31532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:13.981472 31532 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:13.981825 31532 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:13.981881 31532 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:13.981922 31532 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:13.981953 31532 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:13.987785 31532 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:42823
I20260809 02:23:13.987829 31667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:42823 every 8 connection(s)
I20260809 02:23:13.988217 31532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:23:13.993603 31509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.988996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:35385 (local address 127.11.93.190:39751)
0809 02:23:13.989096 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:13.989098 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:13.989334 (+ 236us) server_negotiation.cc:407] Connection header received
0809 02:23:13.989826 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:13.989828 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:13.989840 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:13.989905 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:13.990588 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.991115 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.992079 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.992339 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.992400 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.993258 (+ 858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:13.993260 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:13.993260 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:13.993268 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:13.993286 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:13.993290 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:13.993353 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:13.993505 (+ 152us) server_negotiation.cc:299] Negotiation successful
0809 02:23:13.993533 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 02:23:13.993762 31670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:13.988975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:39751 (local address 127.11.93.129:35385)
0809 02:23:13.989194 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:13.989237 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:13.989717 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:13.989980 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:13.989984 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:13.989991 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:13.990487 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:13.990491 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.991197 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.991198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:13.991979 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:13.991981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:13.992431 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:13.992431 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:13.992542 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:13.993093 (+ 551us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:23:13.993093 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:13.993122 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:23:13.993144 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:13.993389 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:13.993397 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:13.993400 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:23:13.993472 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 02:23:13.993558 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":110,"threads_started":1}
I20260809 02:23:13.994335 31668 heartbeater.cc:347] Connected to a master server at 127.11.93.190:39751
I20260809 02:23:13.994429 31668 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:13.994572 31668 heartbeater.cc:511] Master 127.11.93.190:39751 requested a full tablet report, sending...
I20260809 02:23:13.994890 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 31532
I20260809 02:23:13.995059 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:23:13.995265 31468 ts_manager.cc:194] Registered new tserver with Master: 6fe44f99b015432e92d4dc488f6c00c0 (127.11.93.129:42823)
I20260809 02:23:13.995329 11638 external_mini_cluster.cc:1428] Setting key 0f3a9c609d3b0fb091cfe6bf7f0b85b0
I20260809 02:23:13.996201 31468 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.93.129:35385
I20260809 02:23:13.996635 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:39751
--builtin_ntp_servers=127.11.93.148:35843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:23:14.079875 31671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:14.080097 31671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:14.080119 31671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:14.081295 31671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:14.081341 31671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:14.081367 31671 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:23:14.082691 31671 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:39751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:14.082934 31671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:14.083249 31671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:14.088254 31676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:14.088378 31671 server_base.cc:1034] running on GCE node
W20260809 02:23:14.088322 31677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:14.088266 31679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:14.088768 31671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:14.089025 31671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:14.090183 31671 hybrid_clock.cc:648] HybridClock initialized: now 1786242194090167 us; error 36 us; skew 500 ppm
I20260809 02:23:14.095750 31671 webserver.cc:460] Webserver started at http://127.11.93.130:36829/ using document root <none> and password file <none>
I20260809 02:23:14.096004 31671 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:14.096074 31671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:14.096235 31671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:14.097311 31671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "7c6871db30634f5783fac6d6b53c48b6"
format_stamp: "Formatted at 2026-08-09 02:23:14 on dist-test-slave-w206"
server_key: "06b4c0ce8de67e4f12286bd9fadd48e4"
server_key_iv: "10e0779543e3b0815671ca76ffb2eeaf"
server_key_version: "encryptionkey@0"
I20260809 02:23:14.097697 31671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "7c6871db30634f5783fac6d6b53c48b6"
format_stamp: "Formatted at 2026-08-09 02:23:14 on dist-test-slave-w206"
server_key: "06b4c0ce8de67e4f12286bd9fadd48e4"
server_key_iv: "10e0779543e3b0815671ca76ffb2eeaf"
server_key_version: "encryptionkey@0"
I20260809 02:23:14.099093 31671 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 02:23:14.099881 31687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:14.100065 31671 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:14.100164 31671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "7c6871db30634f5783fac6d6b53c48b6"
format_stamp: "Formatted at 2026-08-09 02:23:14 on dist-test-slave-w206"
server_key: "06b4c0ce8de67e4f12286bd9fadd48e4"
server_key_iv: "10e0779543e3b0815671ca76ffb2eeaf"
server_key_version: "encryptionkey@0"
I20260809 02:23:14.100250 31671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:14.119632 31671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:14.119963 31671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:14.120118 31671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:14.120373 31671 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:14.120711 31671 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:14.120765 31671 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:14.120806 31671 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:14.120832 31671 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:14.126642 31671 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:46535
I20260809 02:23:14.126689 31813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:46535 every 8 connection(s)
I20260809 02:23:14.127074 31671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:23:14.132637 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 31671
I20260809 02:23:14.132737 31509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:14.127900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:51183 (local address 127.11.93.190:39751)
0809 02:23:14.128006 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:14.128009 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:14.128200 (+ 191us) server_negotiation.cc:407] Connection header received
0809 02:23:14.128794 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:14.128795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:14.128807 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:14.128873 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:14.129550 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.130079 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.131124 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.131341 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.131432 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:14.132355 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:14.132357 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:14.132357 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:14.132363 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:14.132380 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:14.132384 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:14.132493 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:14.132606 (+ 113us) server_negotiation.cc:299] Negotiation successful
0809 02:23:14.132639 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 02:23:14.132776 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:23:14.132994 31816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:14.127855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:39751 (local address 127.11.93.130:51183)
0809 02:23:14.128076 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:14.128111 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:14.128673 (+ 562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:14.128951 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:14.128954 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:14.128962 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:14.129456 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:14.129460 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.130180 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.130181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:14.131039 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:14.131042 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.131445 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.131446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:14.131575 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:14.132089 (+ 514us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:23:14.132089 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:14.132121 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:23:14.132156 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:14.132499 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:14.132506 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:14.132510 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:23:14.132607 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 02:23:14.132722 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":83,"threads_started":1}
I20260809 02:23:14.133019 11638 external_mini_cluster.cc:1428] Setting key 2c9eeae4a7cc5465380241f3d0f762ce
I20260809 02:23:14.133602 31814 heartbeater.cc:347] Connected to a master server at 127.11.93.190:39751
I20260809 02:23:14.133718 31814 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:14.133910 31814 heartbeater.cc:511] Master 127.11.93.190:39751 requested a full tablet report, sending...
I20260809 02:23:14.134225 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:39751
--builtin_ntp_servers=127.11.93.148:35843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 02:23:14.134372 31467 ts_manager.cc:194] Registered new tserver with Master: 7c6871db30634f5783fac6d6b53c48b6 (127.11.93.130:46535)
I20260809 02:23:14.134744 31467 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.93.130:51183
W20260809 02:23:14.222256 31818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:14.222481 31818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:14.222502 31818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:14.223660 31818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:14.223696 31818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:14.223723 31818 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:23:14.225013 31818 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:39751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31818
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:14.225200 31818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:14.225462 31818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:14.230656 31824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:14.230664 31823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:14.230722 31826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:14.231006 31818 server_base.cc:1034] running on GCE node
I20260809 02:23:14.231213 31818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:14.231488 31818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:14.232681 31818 hybrid_clock.cc:648] HybridClock initialized: now 1786242194232659 us; error 46 us; skew 500 ppm
I20260809 02:23:14.233983 31818 webserver.cc:460] Webserver started at http://127.11.93.131:42491/ using document root <none> and password file <none>
I20260809 02:23:14.234326 31818 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:14.234393 31818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:14.234541 31818 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:14.236166 31818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "2bd07de851c146948708a080283dc9a5"
format_stamp: "Formatted at 2026-08-09 02:23:14 on dist-test-slave-w206"
server_key: "099fe2d1262e74ab3b79769f0d4bd851"
server_key_iv: "c9b516765a60fc4844b3496605128536"
server_key_version: "encryptionkey@0"
I20260809 02:23:14.236546 31818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "2bd07de851c146948708a080283dc9a5"
format_stamp: "Formatted at 2026-08-09 02:23:14 on dist-test-slave-w206"
server_key: "099fe2d1262e74ab3b79769f0d4bd851"
server_key_iv: "c9b516765a60fc4844b3496605128536"
server_key_version: "encryptionkey@0"
I20260809 02:23:14.238274 31818 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:23:14.239478 31833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:14.239629 31818 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:14.239714 31818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "2bd07de851c146948708a080283dc9a5"
format_stamp: "Formatted at 2026-08-09 02:23:14 on dist-test-slave-w206"
server_key: "099fe2d1262e74ab3b79769f0d4bd851"
server_key_iv: "c9b516765a60fc4844b3496605128536"
server_key_version: "encryptionkey@0"
I20260809 02:23:14.239786 31818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:14.256309 31818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:14.256599 31818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:14.256708 31818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:14.256909 31818 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:14.257269 31818 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:14.257308 31818 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:14.257364 31818 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:14.257390 31818 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:14.263669 31818 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:35197
I20260809 02:23:14.263720 31956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:35197 every 8 connection(s)
I20260809 02:23:14.264073 31818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:23:14.269240 31509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:14.264834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:37113 (local address 127.11.93.190:39751)
0809 02:23:14.264905 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:14.264906 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:14.265156 (+ 250us) server_negotiation.cc:407] Connection header received
0809 02:23:14.265646 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:14.265647 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:14.265656 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:14.265720 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:14.266386 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.266901 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.267912 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.268103 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.268162 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:14.268989 (+ 827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:14.268990 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:14.268990 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:14.268994 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:14.269009 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:14.269012 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:14.269056 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:14.269156 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 02:23:14.269180 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:23:14.269510 31959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:14.264782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:39751 (local address 127.11.93.131:37113)
0809 02:23:14.265011 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:14.265056 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:14.265559 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:14.265789 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:14.265792 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:14.265800 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:14.266309 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:14.266313 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.267026 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.267027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:14.267818 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:14.267820 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.268182 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.268182 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:14.268289 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:14.268810 (+ 521us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:23:14.268810 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:14.268845 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:23:14.268867 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:14.269079 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:14.269084 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:14.269087 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:23:14.269156 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 02:23:14.269267 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":123,"threads_started":1}
I20260809 02:23:14.270061 31957 heartbeater.cc:347] Connected to a master server at 127.11.93.190:39751
I20260809 02:23:14.270174 31957 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:14.270371 31957 heartbeater.cc:511] Master 127.11.93.190:39751 requested a full tablet report, sending...
I20260809 02:23:14.270730 31467 ts_manager.cc:194] Registered new tserver with Master: 2bd07de851c146948708a080283dc9a5 (127.11.93.131:35197)
I20260809 02:23:14.271174 31467 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.93.131:37113
I20260809 02:23:14.273617 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 31818
I20260809 02:23:14.273742 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:23:14.273957 11638 external_mini_cluster.cc:1428] Setting key 23b5c8fb0c045e8111535cb52761f27b
I20260809 02:23:14.274861 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:23:14.279582 31509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:14.276447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58202 (local address 127.11.93.190:39751)
0809 02:23:14.276523 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:14.276525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:14.276539 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:23:14.276612 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:14.276612 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:14.276622 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:14.276688 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:14.276825 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.277366 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.278075 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.278261 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.278325 (+ 64us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:14.279076 (+ 751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:14.279078 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:14.279078 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:14.279083 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:14.279101 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:14.279106 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:14.279290 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:14.279465 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 02:23:14.279479 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:23:14.281632 31467 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58202:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:23:14.283427 31467 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:23:14.290367 31972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:14.285980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59190 (local address 127.11.93.130:46535)
0809 02:23:14.286465 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:14.286469 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:14.286479 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:23:14.286518 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:14.286519 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:14.286535 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:14.286609 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:14.286791 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.288036 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.289466 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.289962 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.290053 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:14.290151 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:14.290243 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 02:23:14.290283 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":109,"threads_started":1}
I20260809 02:23:14.290356 31966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:14.285719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:46535 (local address 127.0.0.1:59190)
0809 02:23:14.286220 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:14.286233 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:14.286291 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:14.286678 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:14.286679 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:14.286681 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:14.286716 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:14.286717 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.288137 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.288138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:14.289380 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:14.289381 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.290065 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.290066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:14.290140 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:14.290153 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 02:23:14.290227 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 02:23:14.290279 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"mutex_wait_us":50,"thread_start_us":80,"threads_started":1}
I20260809 02:23:14.290709 31968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:14.285722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:42823 (local address 127.0.0.1:43770)
0809 02:23:14.286400 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:14.286410 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:14.286456 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:14.286767 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:14.286768 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:14.286770 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:14.286816 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:14.286818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.287923 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.287924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:14.289336 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:14.289340 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.290416 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.290417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:14.290497 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:14.290503 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 02:23:14.290568 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 02:23:14.290612 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"mutex_wait_us":98,"thread_start_us":88,"threads_started":1}
I20260809 02:23:14.290964 31973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:14.285980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47232 (local address 127.11.93.131:35197)
0809 02:23:14.286182 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:14.286186 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:14.286194 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:23:14.286227 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:14.286228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:14.286240 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:14.286333 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:14.286509 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.287698 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.289351 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.290182 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.290274 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:14.290369 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:14.290678 (+ 309us) server_negotiation.cc:299] Negotiation successful
0809 02:23:14.290723 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":107,"threads_started":1}
I20260809 02:23:14.291096 31970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:14.285826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43770 (local address 127.11.93.129:42823)
0809 02:23:14.286229 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:14.286235 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:14.286523 (+ 288us) server_negotiation.cc:407] Connection header received
0809 02:23:14.286575 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:14.286578 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:14.286594 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:14.286677 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:14.286912 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.287800 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.289415 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.290205 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.290277 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:14.290368 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:14.290904 (+ 536us) server_negotiation.cc:299] Negotiation successful
0809 02:23:14.290953 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":81,"threads_started":1}
I20260809 02:23:14.291280 31969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:14.285719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:35197 (local address 127.0.0.1:47232)
0809 02:23:14.285917 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:14.285958 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:14.286020 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:14.286332 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:14.286335 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:14.286337 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:14.286418 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:14.286420 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.287790 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.287791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:14.289240 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:14.289243 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.290418 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.290419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:14.290497 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:14.290503 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 02:23:14.290568 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 02:23:14.290612 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":21,"thread_start_us":77,"threads_started":1}
I20260809 02:23:14.291488 31742 tablet_service.cc:1467] Processing CreateTablet for tablet 1996c33a58834ae3a1895b3357a2624d (DEFAULT_TABLE table=test-table [id=49133f4f50e94cbaadaf692c4ffcdd5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:14.291903 31742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1996c33a58834ae3a1895b3357a2624d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:14.291826 31597 tablet_service.cc:1467] Processing CreateTablet for tablet 1996c33a58834ae3a1895b3357a2624d (DEFAULT_TABLE table=test-table [id=49133f4f50e94cbaadaf692c4ffcdd5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:14.291976 31885 tablet_service.cc:1467] Processing CreateTablet for tablet 1996c33a58834ae3a1895b3357a2624d (DEFAULT_TABLE table=test-table [id=49133f4f50e94cbaadaf692c4ffcdd5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:14.292223 31597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1996c33a58834ae3a1895b3357a2624d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:14.292369 31885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1996c33a58834ae3a1895b3357a2624d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:14.294866 31974 tablet_bootstrap.cc:492] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6: Bootstrap starting.
I20260809 02:23:14.295614 31974 tablet_bootstrap.cc:654] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:14.295936 31974 log.cc:824] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:14.296244 31976 tablet_bootstrap.cc:492] T 1996c33a58834ae3a1895b3357a2624d P 6fe44f99b015432e92d4dc488f6c00c0: Bootstrap starting.
I20260809 02:23:14.296806 31976 tablet_bootstrap.cc:654] T 1996c33a58834ae3a1895b3357a2624d P 6fe44f99b015432e92d4dc488f6c00c0: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:14.297096 31976 log.cc:824] T 1996c33a58834ae3a1895b3357a2624d P 6fe44f99b015432e92d4dc488f6c00c0: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:14.297401 31975 tablet_bootstrap.cc:492] T 1996c33a58834ae3a1895b3357a2624d P 2bd07de851c146948708a080283dc9a5: Bootstrap starting.
I20260809 02:23:14.298056 31975 tablet_bootstrap.cc:654] T 1996c33a58834ae3a1895b3357a2624d P 2bd07de851c146948708a080283dc9a5: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:14.298121 31976 tablet_bootstrap.cc:492] T 1996c33a58834ae3a1895b3357a2624d P 6fe44f99b015432e92d4dc488f6c00c0: No bootstrap required, opened a new log
I20260809 02:23:14.298183 31976 ts_tablet_manager.cc:1397] T 1996c33a58834ae3a1895b3357a2624d P 6fe44f99b015432e92d4dc488f6c00c0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:23:14.298399 31975 log.cc:824] T 1996c33a58834ae3a1895b3357a2624d P 2bd07de851c146948708a080283dc9a5: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:14.299182 31975 tablet_bootstrap.cc:492] T 1996c33a58834ae3a1895b3357a2624d P 2bd07de851c146948708a080283dc9a5: No bootstrap required, opened a new log
I20260809 02:23:14.299192 31974 tablet_bootstrap.cc:492] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6: No bootstrap required, opened a new log
I20260809 02:23:14.299259 31974 ts_tablet_manager.cc:1397] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260809 02:23:14.299310 31975 ts_tablet_manager.cc:1397] T 1996c33a58834ae3a1895b3357a2624d P 2bd07de851c146948708a080283dc9a5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:23:14.300426 31976 raft_consensus.cc:348] T 1996c33a58834ae3a1895b3357a2624d P 6fe44f99b015432e92d4dc488f6c00c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c6871db30634f5783fac6d6b53c48b6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 46535 } } peers { permanent_uuid: "2bd07de851c146948708a080283dc9a5" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 35197 } } peers { permanent_uuid: "6fe44f99b015432e92d4dc488f6c00c0" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 42823 } }
I20260809 02:23:14.300592 31976 raft_consensus.cc:374] T 1996c33a58834ae3a1895b3357a2624d P 6fe44f99b015432e92d4dc488f6c00c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:14.300637 31976 raft_consensus.cc:729] T 1996c33a58834ae3a1895b3357a2624d P 6fe44f99b015432e92d4dc488f6c00c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fe44f99b015432e92d4dc488f6c00c0, State: Initialized, Role: FOLLOWER
I20260809 02:23:14.300813 31976 consensus_queue.cc:260] T 1996c33a58834ae3a1895b3357a2624d P 6fe44f99b015432e92d4dc488f6c00c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c6871db30634f5783fac6d6b53c48b6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 46535 } } peers { permanent_uuid: "2bd07de851c146948708a080283dc9a5" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 35197 } } peers { permanent_uuid: "6fe44f99b015432e92d4dc488f6c00c0" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 42823 } }
I20260809 02:23:14.301117 31976 ts_tablet_manager.cc:1428] T 1996c33a58834ae3a1895b3357a2624d P 6fe44f99b015432e92d4dc488f6c00c0: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 02:23:14.301138 31668 heartbeater.cc:503] Master 127.11.93.190:39751 was elected leader, sending a full tablet report...
I20260809 02:23:14.301895 31975 raft_consensus.cc:348] T 1996c33a58834ae3a1895b3357a2624d P 2bd07de851c146948708a080283dc9a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c6871db30634f5783fac6d6b53c48b6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 46535 } } peers { permanent_uuid: "2bd07de851c146948708a080283dc9a5" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 35197 } } peers { permanent_uuid: "6fe44f99b015432e92d4dc488f6c00c0" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 42823 } }
I20260809 02:23:14.302063 31975 raft_consensus.cc:374] T 1996c33a58834ae3a1895b3357a2624d P 2bd07de851c146948708a080283dc9a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:14.302100 31975 raft_consensus.cc:729] T 1996c33a58834ae3a1895b3357a2624d P 2bd07de851c146948708a080283dc9a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd07de851c146948708a080283dc9a5, State: Initialized, Role: FOLLOWER
I20260809 02:23:14.301895 31974 raft_consensus.cc:348] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c6871db30634f5783fac6d6b53c48b6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 46535 } } peers { permanent_uuid: "2bd07de851c146948708a080283dc9a5" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 35197 } } peers { permanent_uuid: "6fe44f99b015432e92d4dc488f6c00c0" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 42823 } }
I20260809 02:23:14.302142 31974 raft_consensus.cc:374] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:14.302175 31974 raft_consensus.cc:729] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c6871db30634f5783fac6d6b53c48b6, State: Initialized, Role: FOLLOWER
I20260809 02:23:14.302227 31975 consensus_queue.cc:260] T 1996c33a58834ae3a1895b3357a2624d P 2bd07de851c146948708a080283dc9a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c6871db30634f5783fac6d6b53c48b6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 46535 } } peers { permanent_uuid: "2bd07de851c146948708a080283dc9a5" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 35197 } } peers { permanent_uuid: "6fe44f99b015432e92d4dc488f6c00c0" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 42823 } }
I20260809 02:23:14.302301 31974 consensus_queue.cc:260] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c6871db30634f5783fac6d6b53c48b6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 46535 } } peers { permanent_uuid: "2bd07de851c146948708a080283dc9a5" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 35197 } } peers { permanent_uuid: "6fe44f99b015432e92d4dc488f6c00c0" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 42823 } }
I20260809 02:23:14.302523 31974 ts_tablet_manager.cc:1428] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 02:23:14.302521 31975 ts_tablet_manager.cc:1428] T 1996c33a58834ae3a1895b3357a2624d P 2bd07de851c146948708a080283dc9a5: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 02:23:14.302577 31957 heartbeater.cc:503] Master 127.11.93.190:39751 was elected leader, sending a full tablet report...
I20260809 02:23:14.302577 31814 heartbeater.cc:503] Master 127.11.93.190:39751 was elected leader, sending a full tablet report...
W20260809 02:23:14.377656 31815 tablet.cc:2369] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:23:14.431417 31983 raft_consensus.cc:482] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:23:14.431604 31983 raft_consensus.cc:504] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c6871db30634f5783fac6d6b53c48b6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 46535 } } peers { permanent_uuid: "2bd07de851c146948708a080283dc9a5" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 35197 } } peers { permanent_uuid: "6fe44f99b015432e92d4dc488f6c00c0" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 42823 } }
I20260809 02:23:14.432046 31983 leader_election.cc:288] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bd07de851c146948708a080283dc9a5 (127.11.93.131:35197), 6fe44f99b015432e92d4dc488f6c00c0 (127.11.93.129:42823)
I20260809 02:23:14.435197 31973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:14.432350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:55125 (local address 127.11.93.131:35197)
0809 02:23:14.432391 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:14.432394 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:14.432402 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:23:14.432433 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:14.432435 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:14.432449 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:14.432521 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:14.432770 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.433298 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.434420 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.434784 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.434846 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:14.434853 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:14.435056 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 02:23:14.435101 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 02:23:14.435202 31816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:14.432219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:35197 (local address 127.11.93.130:55125)
0809 02:23:14.432288 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:14.432303 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:14.432353 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:14.432596 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:14.432597 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:14.432599 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:14.432687 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:14.432690 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.433391 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.433392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:14.434319 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:14.434322 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.434871 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.434872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:14.434951 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:14.434956 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:23:14.435053 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 02:23:14.435109 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":1}
I20260809 02:23:14.435333 31970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:14.432335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:43487 (local address 127.11.93.129:42823)
0809 02:23:14.432381 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:14.432384 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:14.432599 (+ 215us) server_negotiation.cc:407] Connection header received
0809 02:23:14.432633 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:14.432635 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:14.432649 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:14.432719 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:14.432911 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.433500 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.434468 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.434908 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.435028 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:14.435037 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:14.435205 (+ 168us) server_negotiation.cc:299] Negotiation successful
0809 02:23:14.435256 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 02:23:14.435364 31984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:14.432265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:42823 (local address 127.11.93.130:43487)
0809 02:23:14.432463 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:14.432474 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:14.432535 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:14.432744 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:14.432745 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:14.432747 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:14.432823 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:14.432825 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.433585 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.433586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:14.434341 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:14.434343 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.435037 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.435038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:14.435117 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:14.435120 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:23:14.435179 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 02:23:14.435215 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"mutex_wait_us":3,"thread_start_us":109,"threads_started":1}
I20260809 02:23:14.435616 31910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1996c33a58834ae3a1895b3357a2624d" candidate_uuid: "7c6871db30634f5783fac6d6b53c48b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd07de851c146948708a080283dc9a5" is_pre_election: true
I20260809 02:23:14.435775 31910 raft_consensus.cc:2454] T 1996c33a58834ae3a1895b3357a2624d P 2bd07de851c146948708a080283dc9a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c6871db30634f5783fac6d6b53c48b6 in term 0.
I20260809 02:23:14.435788 31619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1996c33a58834ae3a1895b3357a2624d" candidate_uuid: "7c6871db30634f5783fac6d6b53c48b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fe44f99b015432e92d4dc488f6c00c0" is_pre_election: true
I20260809 02:23:14.435948 31619 raft_consensus.cc:2454] T 1996c33a58834ae3a1895b3357a2624d P 6fe44f99b015432e92d4dc488f6c00c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c6871db30634f5783fac6d6b53c48b6 in term 0.
I20260809 02:23:14.436023 31691 leader_election.cc:302] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd07de851c146948708a080283dc9a5, 7c6871db30634f5783fac6d6b53c48b6; no voters:
I20260809 02:23:14.436159 31983 raft_consensus.cc:2781] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:23:14.436206 31983 raft_consensus.cc:482] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:23:14.436229 31983 raft_consensus.cc:3037] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:14.436954 31983 raft_consensus.cc:504] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c6871db30634f5783fac6d6b53c48b6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 46535 } } peers { permanent_uuid: "2bd07de851c146948708a080283dc9a5" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 35197 } } peers { permanent_uuid: "6fe44f99b015432e92d4dc488f6c00c0" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 42823 } }
I20260809 02:23:14.437103 31983 leader_election.cc:288] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6 [CANDIDATE]: Term 1 election: Requested vote from peers 2bd07de851c146948708a080283dc9a5 (127.11.93.131:35197), 6fe44f99b015432e92d4dc488f6c00c0 (127.11.93.129:42823)
I20260809 02:23:14.437263 31910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1996c33a58834ae3a1895b3357a2624d" candidate_uuid: "7c6871db30634f5783fac6d6b53c48b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd07de851c146948708a080283dc9a5"
I20260809 02:23:14.437340 31910 raft_consensus.cc:3037] T 1996c33a58834ae3a1895b3357a2624d P 2bd07de851c146948708a080283dc9a5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:14.437356 31619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1996c33a58834ae3a1895b3357a2624d" candidate_uuid: "7c6871db30634f5783fac6d6b53c48b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fe44f99b015432e92d4dc488f6c00c0"
I20260809 02:23:14.437443 31619 raft_consensus.cc:3037] T 1996c33a58834ae3a1895b3357a2624d P 6fe44f99b015432e92d4dc488f6c00c0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:14.438133 31910 raft_consensus.cc:2454] T 1996c33a58834ae3a1895b3357a2624d P 2bd07de851c146948708a080283dc9a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c6871db30634f5783fac6d6b53c48b6 in term 1.
I20260809 02:23:14.438313 31619 raft_consensus.cc:2454] T 1996c33a58834ae3a1895b3357a2624d P 6fe44f99b015432e92d4dc488f6c00c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c6871db30634f5783fac6d6b53c48b6 in term 1.
I20260809 02:23:14.438305 31691 leader_election.cc:302] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bd07de851c146948708a080283dc9a5, 7c6871db30634f5783fac6d6b53c48b6; no voters:
I20260809 02:23:14.438427 31983 raft_consensus.cc:2781] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:14.438591 31983 raft_consensus.cc:686] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6 [term 1 LEADER]: Becoming Leader. State: Replica: 7c6871db30634f5783fac6d6b53c48b6, State: Running, Role: LEADER
I20260809 02:23:14.438696 31983 consensus_queue.cc:237] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c6871db30634f5783fac6d6b53c48b6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 46535 } } peers { permanent_uuid: "2bd07de851c146948708a080283dc9a5" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 35197 } } peers { permanent_uuid: "6fe44f99b015432e92d4dc488f6c00c0" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 42823 } }
I20260809 02:23:14.439743 31467 catalog_manager.cc:5495] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c6871db30634f5783fac6d6b53c48b6 (127.11.93.130). New cstate: current_term: 1 leader_uuid: "7c6871db30634f5783fac6d6b53c48b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c6871db30634f5783fac6d6b53c48b6" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 46535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bd07de851c146948708a080283dc9a5" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 35197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fe44f99b015432e92d4dc488f6c00c0" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 42823 } health_report { overall_health: UNKNOWN } } }
I20260809 02:23:14.473150 31972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:14.470353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59200 (local address 127.11.93.130:46535)
0809 02:23:14.470443 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:14.470445 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:14.470455 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:23:14.470504 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:14.470505 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:14.470528 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:14.470617 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:14.470847 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.471428 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.472360 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:14.472544 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:14.472595 (+ 51us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:14.472795 (+ 200us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:14.472891 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:14.472968 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:14.473057 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 02:23:14.473068 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:23:14.475327 31619 raft_consensus.cc:1261] T 1996c33a58834ae3a1895b3357a2624d P 6fe44f99b015432e92d4dc488f6c00c0 [term 1 FOLLOWER]: Refusing update from remote peer 7c6871db30634f5783fac6d6b53c48b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:14.475348 31910 raft_consensus.cc:1261] T 1996c33a58834ae3a1895b3357a2624d P 2bd07de851c146948708a080283dc9a5 [term 1 FOLLOWER]: Refusing update from remote peer 7c6871db30634f5783fac6d6b53c48b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:14.475741 31985 consensus_queue.cc:1035] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fe44f99b015432e92d4dc488f6c00c0" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 42823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:14.475888 31983 consensus_queue.cc:1035] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd07de851c146948708a080283dc9a5" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 35197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:14.478322 31988 mvcc.cc:205] Tried to move back new op lower bound from 7316448028567375872 to 7316448028421505024. Current Snapshot: MvccSnapshot[applied={T|T < 7316448028567375872}]
I20260809 02:23:14.481534 31467 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58202:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:23:14.481642 31467 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58202:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:23:14.482467 31467 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1f471b3c44164ca28cca34921e5dfd3d: Sending DeleteTablet for 3 replicas of tablet 1996c33a58834ae3a1895b3357a2624d
I20260809 02:23:14.482796 31742 tablet_service.cc:1514] Processing DeleteTablet for tablet 1996c33a58834ae3a1895b3357a2624d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:14 UTC) from {username='slave'} at 127.0.0.1:59190
I20260809 02:23:14.482897 31885 tablet_service.cc:1514] Processing DeleteTablet for tablet 1996c33a58834ae3a1895b3357a2624d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:14 UTC) from {username='slave'} at 127.0.0.1:47232
I20260809 02:23:14.483001 31597 tablet_service.cc:1514] Processing DeleteTablet for tablet 1996c33a58834ae3a1895b3357a2624d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:14 UTC) from {username='slave'} at 127.0.0.1:43770
I20260809 02:23:14.483134 31997 tablet_replica.cc:330] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6: stopping tablet replica
I20260809 02:23:14.483197 31999 tablet_replica.cc:330] T 1996c33a58834ae3a1895b3357a2624d P 6fe44f99b015432e92d4dc488f6c00c0: stopping tablet replica
I20260809 02:23:14.483243 31997 raft_consensus.cc:2229] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:23:14.483286 31999 raft_consensus.cc:2229] T 1996c33a58834ae3a1895b3357a2624d P 6fe44f99b015432e92d4dc488f6c00c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:23:14.483354 31997 raft_consensus.cc:2258] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:23:14.483378 31999 raft_consensus.cc:2258] T 1996c33a58834ae3a1895b3357a2624d P 6fe44f99b015432e92d4dc488f6c00c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:23:14.483402 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 31532
I20260809 02:23:14.484861 31997 ts_tablet_manager.cc:1905] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:23:14.486639 31997 ts_tablet_manager.cc:1918] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:23:14.486709 31997 log.cc:1196] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/1996c33a58834ae3a1895b3357a2624d
I20260809 02:23:14.487026 31997 ts_tablet_manager.cc:1939] T 1996c33a58834ae3a1895b3357a2624d P 7c6871db30634f5783fac6d6b53c48b6: Deleting consensus metadata
I20260809 02:23:14.487607 31452 catalog_manager.cc:4841] TS 7c6871db30634f5783fac6d6b53c48b6 (127.11.93.130:46535): tablet 1996c33a58834ae3a1895b3357a2624d (table test-table [id=49133f4f50e94cbaadaf692c4ffcdd5e]) successfully deleted
I20260809 02:23:14.491159 31998 tablet_replica.cc:330] T 1996c33a58834ae3a1895b3357a2624d P 2bd07de851c146948708a080283dc9a5: stopping tablet replica
I20260809 02:23:14.491293 31998 raft_consensus.cc:2229] T 1996c33a58834ae3a1895b3357a2624d P 2bd07de851c146948708a080283dc9a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:23:14.491429 31998 raft_consensus.cc:2258] T 1996c33a58834ae3a1895b3357a2624d P 2bd07de851c146948708a080283dc9a5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 02:23:14.491885 31451 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.93.129:42823 (error 108)
I20260809 02:23:14.491936 31998 ts_tablet_manager.cc:1905] T 1996c33a58834ae3a1895b3357a2624d P 2bd07de851c146948708a080283dc9a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:23:14.492560 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 31671
I20260809 02:23:14.493449 31968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:14.492637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:42823 (local address 127.0.0.1:43782)
0809 02:23:14.493354 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:14.493417 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.129:42823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":693}
W20260809 02:23:14.493585 31451 catalog_manager.cc:4584] TS 6fe44f99b015432e92d4dc488f6c00c0 (127.11.93.129:42823): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1996c33a58834ae3a1895b3357a2624d: Network error: Client connection negotiation failed: client connection to 127.11.93.129:42823: connect: Connection refused (error 111)
I20260809 02:23:14.493889 31998 ts_tablet_manager.cc:1918] T 1996c33a58834ae3a1895b3357a2624d P 2bd07de851c146948708a080283dc9a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:23:14.493969 31998 log.cc:1196] T 1996c33a58834ae3a1895b3357a2624d P 2bd07de851c146948708a080283dc9a5: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/1996c33a58834ae3a1895b3357a2624d
I20260809 02:23:14.494221 31998 ts_tablet_manager.cc:1939] T 1996c33a58834ae3a1895b3357a2624d P 2bd07de851c146948708a080283dc9a5: Deleting consensus metadata
I20260809 02:23:14.494720 31454 catalog_manager.cc:4841] TS 2bd07de851c146948708a080283dc9a5 (127.11.93.131:35197): tablet 1996c33a58834ae3a1895b3357a2624d (table test-table [id=49133f4f50e94cbaadaf692c4ffcdd5e]) successfully deleted
I20260809 02:23:14.498492 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 31818
I20260809 02:23:14.504886 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 31432
2026-08-09T02:23:14Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (866 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:14 dist-test-slave-w206 krb5kdc[32004](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:14 dist-test-slave-w206 krb5kdc[32004](info): set up 2 sockets
Aug 09 02:23:14 dist-test-slave-w206 krb5kdc[32004](info): commencing operation
krb5kdc: starting...
W20260809 02:23:15.566273 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.040s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:23:15 dist-test-slave-w206 krb5kdc[32004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242195, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:23:15.693308 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:38207
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:45429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:38207
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:15.777247 32017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:15.777504 32017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:15.777540 32017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:15.778671 32017 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:15.778748 32017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:15.778774 32017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:15.778795 32017 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:15.778820 32017 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:15.780364 32017 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:45429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:38207
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:38207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32017
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:15.780640 32017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:15.780865 32017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:15.785912 32024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:15.785871 32026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:15.785936 32017 server_base.cc:1034] running on GCE node
W20260809 02:23:15.785876 32022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:15.786369 32017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:15.786676 32017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:15.787838 32017 hybrid_clock.cc:648] HybridClock initialized: now 1786242195787825 us; error 30 us; skew 500 ppm
Aug 09 02:23:15 dist-test-slave-w206 krb5kdc[32004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242195, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:15.790341 32017 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:23:15.790787 32017 webserver.cc:460] Webserver started at http://127.11.93.190:33305/ using document root <none> and password file <none>
I20260809 02:23:15.791066 32017 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:15.791136 32017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:15.791277 32017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:15.792368 32017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "32394d4f3e7b4242877f133ce6a96a5b"
format_stamp: "Formatted at 2026-08-09 02:23:15 on dist-test-slave-w206"
server_key: "3d33313370957e1e72db2d6bfce00271"
server_key_iv: "135d280f7b9dcbf285adaacbbffd3d75"
server_key_version: "encryptionkey@0"
I20260809 02:23:15.792733 32017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "32394d4f3e7b4242877f133ce6a96a5b"
format_stamp: "Formatted at 2026-08-09 02:23:15 on dist-test-slave-w206"
server_key: "3d33313370957e1e72db2d6bfce00271"
server_key_iv: "135d280f7b9dcbf285adaacbbffd3d75"
server_key_version: "encryptionkey@0"
I20260809 02:23:15.794082 32017 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:23:15.794909 32033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:15.795156 32017 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:15.795256 32017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "32394d4f3e7b4242877f133ce6a96a5b"
format_stamp: "Formatted at 2026-08-09 02:23:15 on dist-test-slave-w206"
server_key: "3d33313370957e1e72db2d6bfce00271"
server_key_iv: "135d280f7b9dcbf285adaacbbffd3d75"
server_key_version: "encryptionkey@0"
I20260809 02:23:15.795344 32017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:15.807468 32017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:15.809448 32017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:15.809608 32017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:15.813549 32017 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:38207
I20260809 02:23:15.813618 32089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:38207 every 8 connection(s)
I20260809 02:23:15.813966 32017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:15.814881 32090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:15.817122 32090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b: Bootstrap starting.
I20260809 02:23:15.817709 32090 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:15.817999 32090 log.cc:824] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:15.818650 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 32017
I20260809 02:23:15.818735 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:15.818745 32090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b: No bootstrap required, opened a new log
I20260809 02:23:15.819063 11638 external_mini_cluster.cc:1428] Setting key 17191b195abf543458f10741d6ca285b
I20260809 02:23:15.821012 32090 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32394d4f3e7b4242877f133ce6a96a5b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38207 } }
I20260809 02:23:15.821187 32090 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:15.821226 32090 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32394d4f3e7b4242877f133ce6a96a5b, State: Initialized, Role: FOLLOWER
I20260809 02:23:15.821364 32090 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32394d4f3e7b4242877f133ce6a96a5b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38207 } }
I20260809 02:23:15.821453 32090 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:15.821476 32090 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:15.821552 32090 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:15.822621 32090 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32394d4f3e7b4242877f133ce6a96a5b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38207 } }
I20260809 02:23:15.822741 32090 leader_election.cc:302] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32394d4f3e7b4242877f133ce6a96a5b; no voters:
I20260809 02:23:15.822890 32090 leader_election.cc:288] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:15.822994 32097 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:15.823151 32097 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b [term 1 LEADER]: Becoming Leader. State: Replica: 32394d4f3e7b4242877f133ce6a96a5b, State: Running, Role: LEADER
I20260809 02:23:15.823181 32090 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:15.823238 32097 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32394d4f3e7b4242877f133ce6a96a5b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38207 } }
I20260809 02:23:15.823596 32099 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32394d4f3e7b4242877f133ce6a96a5b. Latest consensus state: current_term: 1 leader_uuid: "32394d4f3e7b4242877f133ce6a96a5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32394d4f3e7b4242877f133ce6a96a5b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38207 } } }
I20260809 02:23:15.823693 32099 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:15.824600 32098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32394d4f3e7b4242877f133ce6a96a5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32394d4f3e7b4242877f133ce6a96a5b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38207 } } }
I20260809 02:23:15.824692 32098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b [sys.catalog]: This master's current role is: LEADER
W20260809 02:23:15.825307 32113 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:23:15.825384 32113 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:23:15.826617 32104 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:15.826840 32104 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 02:23:15 dist-test-slave-w206 krb5kdc[32004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242195, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:23:15.828488 32104 catalog_manager.cc:1347] Generated new cluster ID: be789d33997c45cb926c111d99d461e3
I20260809 02:23:15.828540 32104 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:15.838356 32096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:15.819592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54368 (local address 127.11.93.190:38207)
0809 02:23:15.819807 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:15.819817 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:15.819849 (+ 32us) server_negotiation.cc:407] Connection header received
0809 02:23:15.820974 (+ 1125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:15.820984 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:15.821049 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:15.821211 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:15.821986 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.823410 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.824348 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:15.825019 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:15.825150 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:15.828068 (+ 2918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:15.828072 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:15.828072 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:15.828084 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:15.836570 (+ 8486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:15.837011 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:15.837016 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:15.837017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:15.837141 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:15.837397 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:15.837398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:15.837399 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:15.837666 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:15.837878 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:15.837951 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 02:23:15.838108 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":100,"threads_started":1}
I20260809 02:23:15.852837 32104 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:15.853451 32104 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:15.859915 32104 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b: Generated new TSK 0
I20260809 02:23:15.860122 32104 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.93.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
Entry for principal kudu/127.11.93.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab.
I20260809 02:23:15.890058 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:38207
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:45429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:15.973037 32120 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:15.973244 32120 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:15.973268 32120 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:15.974352 32120 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:15.974386 32120 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:15.974411 32120 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:23:15.975909 32120 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:45429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.129.keytab
--principal=kudu/127.11.93.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:38207
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32120
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:15.976109 32120 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:15.976287 32120 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:15.981408 32125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:15.981477 32128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:15.981417 32126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:15.981735 32120 server_base.cc:1034] running on GCE node
I20260809 02:23:15.981937 32120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:15.982131 32120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:15.983274 32120 hybrid_clock.cc:648] HybridClock initialized: now 1786242195983264 us; error 30 us; skew 500 ppm
Aug 09 02:23:15 dist-test-slave-w206 krb5kdc[32004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242195, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:15.985872 32120 init.cc:377] Logged in from keytab as kudu/127.11.93.129@KRBTEST.COM (short username kudu)
I20260809 02:23:15.986310 32120 webserver.cc:460] Webserver started at http://127.11.93.129:34821/ using document root <none> and password file <none>
I20260809 02:23:15.986558 32120 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:15.986629 32120 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:15.986783 32120 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:15.987907 32120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "38e2042c0f2d4879951a63af5cfb9020"
format_stamp: "Formatted at 2026-08-09 02:23:15 on dist-test-slave-w206"
server_key: "fb9b043f0ae2645a0e0ceb597d440cd4"
server_key_iv: "7655ba43150336537d3d6abc9185ab9a"
server_key_version: "encryptionkey@0"
I20260809 02:23:15.988278 32120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "38e2042c0f2d4879951a63af5cfb9020"
format_stamp: "Formatted at 2026-08-09 02:23:15 on dist-test-slave-w206"
server_key: "fb9b043f0ae2645a0e0ceb597d440cd4"
server_key_iv: "7655ba43150336537d3d6abc9185ab9a"
server_key_version: "encryptionkey@0"
I20260809 02:23:15.989650 32120 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:23:15.990526 32135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:15.990721 32120 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:15.990828 32120 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "38e2042c0f2d4879951a63af5cfb9020"
format_stamp: "Formatted at 2026-08-09 02:23:15 on dist-test-slave-w206"
server_key: "fb9b043f0ae2645a0e0ceb597d440cd4"
server_key_iv: "7655ba43150336537d3d6abc9185ab9a"
server_key_version: "encryptionkey@0"
I20260809 02:23:15.990933 32120 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:16.011889 32120 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:16.014052 32120 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:16.014225 32120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:16.014475 32120 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:16.014796 32120 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:16.014860 32120 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:16.014927 32120 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:16.014959 32120 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:16.020984 32120 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:40637
I20260809 02:23:16.021041 32261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:40637 every 8 connection(s)
I20260809 02:23:16.021358 32120 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:23:16.025938 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 32120
I20260809 02:23:16.026103 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:23:16.026337 11638 external_mini_cluster.cc:1428] Setting key d1b12e1520c84e702426c173576e26fe
Aug 09 02:23:16 dist-test-slave-w206 krb5kdc[32004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242195, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.129@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:23:16.032707 32096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:16.022082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:53155 (local address 127.11.93.190:38207)
0809 02:23:16.022157 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:16.022158 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:16.022371 (+ 213us) server_negotiation.cc:407] Connection header received
0809 02:23:16.022905 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:16.022906 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:16.022924 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:16.023014 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:16.024185 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.024751 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.025787 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.026019 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.026105 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:16.029128 (+ 3023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:16.029129 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:16.029130 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:16.029142 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:16.030912 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:16.031418 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:16.031419 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:16.031420 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:16.031489 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:16.031786 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:16.031787 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:16.031787 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:16.031946 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:16.032023 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:16.032459 (+ 436us) server_negotiation.cc:299] Negotiation successful
0809 02:23:16.032563 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:23:16.032703 32264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:16.022068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:38207 (local address 127.11.93.129:53155)
0809 02:23:16.022248 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:16.022286 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:16.022792 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:16.023122 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:16.023127 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:16.023778 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:16.024058 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:16.024063 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.024859 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.024860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:16.025693 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:16.025695 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.026143 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.026144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:16.026288 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:16.027067 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:16.027077 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:16.029010 (+ 1933us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:16.031067 (+ 2057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:16.031075 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:16.031076 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:16.031326 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:16.031562 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:16.031562 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:16.031563 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:16.031675 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:16.032101 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:16.032112 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:16.032292 (+ 180us) client_negotiation.cc:769] Sending connection context
0809 02:23:16.032387 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 02:23:16.032522 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":90,"threads_started":1}
I20260809 02:23:16.033346 32262 heartbeater.cc:347] Connected to a master server at 127.11.93.190:38207
I20260809 02:23:16.033475 32262 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:16.033681 32262 heartbeater.cc:511] Master 127.11.93.190:38207 requested a full tablet report, sending...
I20260809 02:23:16.034296 32050 ts_manager.cc:194] Registered new tserver with Master: 38e2042c0f2d4879951a63af5cfb9020 (127.11.93.129:40637)
I20260809 02:23:16.035260 32050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.129@KRBTEST.COM'} at 127.11.93.129:53155
WARNING: no policy specified for kudu/127.11.93.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
Entry for principal kudu/127.11.93.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab.
I20260809 02:23:16.054246 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:38207
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:45429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:16.137769 32267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:16.138036 32267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:16.138075 32267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:16.139293 32267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:16.139366 32267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:16.139411 32267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:23:16.140962 32267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:45429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.130.keytab
--principal=kudu/127.11.93.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:38207
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:16.141251 32267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:16.141489 32267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:16.146608 32275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:16.146584 32272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:16.146588 32273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:16.146966 32267 server_base.cc:1034] running on GCE node
I20260809 02:23:16.147215 32267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:16.147461 32267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:16.148624 32267 hybrid_clock.cc:648] HybridClock initialized: now 1786242196148606 us; error 29 us; skew 500 ppm
Aug 09 02:23:16 dist-test-slave-w206 krb5kdc[32004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242196, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:16.151316 32267 init.cc:377] Logged in from keytab as kudu/127.11.93.130@KRBTEST.COM (short username kudu)
I20260809 02:23:16.151768 32267 webserver.cc:460] Webserver started at http://127.11.93.130:37269/ using document root <none> and password file <none>
I20260809 02:23:16.152006 32267 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:16.152053 32267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:16.152187 32267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:16.153275 32267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "00f6ccd2a2664723b81114af652b5c4c"
format_stamp: "Formatted at 2026-08-09 02:23:16 on dist-test-slave-w206"
server_key: "a0a69f643a5278fe4628c50329711206"
server_key_iv: "966355aa72a82e388dee2ec82db94684"
server_key_version: "encryptionkey@0"
I20260809 02:23:16.153653 32267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "00f6ccd2a2664723b81114af652b5c4c"
format_stamp: "Formatted at 2026-08-09 02:23:16 on dist-test-slave-w206"
server_key: "a0a69f643a5278fe4628c50329711206"
server_key_iv: "966355aa72a82e388dee2ec82db94684"
server_key_version: "encryptionkey@0"
I20260809 02:23:16.155095 32267 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:23:16.155913 32283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:16.156104 32267 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:23:16.156198 32267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "00f6ccd2a2664723b81114af652b5c4c"
format_stamp: "Formatted at 2026-08-09 02:23:16 on dist-test-slave-w206"
server_key: "a0a69f643a5278fe4628c50329711206"
server_key_iv: "966355aa72a82e388dee2ec82db94684"
server_key_version: "encryptionkey@0"
I20260809 02:23:16.156276 32267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:16.193606 32267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:16.195968 32267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:16.196089 32267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:16.196338 32267 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:16.196683 32267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:16.196723 32267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:16.196769 32267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:16.196799 32267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:16.202760 32267 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:38349
I20260809 02:23:16.202847 32407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:38349 every 8 connection(s)
I20260809 02:23:16.203197 32267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
Aug 09 02:23:16 dist-test-slave-w206 krb5kdc[32004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242196, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.130@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:23:16.210215 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 32267
I20260809 02:23:16.210376 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:23:16.210608 11638 external_mini_cluster.cc:1428] Setting key 8a8cb54e107852d46c02ef29035b382c
I20260809 02:23:16.213750 32096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:16.203958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:52321 (local address 127.11.93.190:38207)
0809 02:23:16.204029 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:16.204031 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:16.204260 (+ 229us) server_negotiation.cc:407] Connection header received
0809 02:23:16.205248 (+ 988us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:16.205249 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:16.205260 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:16.205324 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:16.205948 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.206491 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.207497 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.207718 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.207793 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:16.209938 (+ 2145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:16.209940 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:16.209940 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:16.209947 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:16.211813 (+ 1866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:16.212433 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:16.212434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:16.212435 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:16.212506 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:16.212810 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:16.212811 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:16.212812 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:16.212975 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:16.213045 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:16.213526 (+ 481us) server_negotiation.cc:299] Negotiation successful
0809 02:23:16.213639 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:23:16.213909 32410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:16.203923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:38207 (local address 127.11.93.130:52321)
0809 02:23:16.204115 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:16.204160 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:16.205099 (+ 939us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:16.205403 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:16.205406 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:16.205662 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:16.205869 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:16.205873 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.206578 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.206579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:16.207405 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:16.207407 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.207806 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.207806 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:16.207916 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:16.208436 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:16.208444 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:16.209833 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:16.212053 (+ 2220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:16.212060 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:16.212062 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:16.212348 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:16.212595 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:16.212596 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:16.212596 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:16.212725 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:16.213068 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:16.213075 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:16.213337 (+ 262us) client_negotiation.cc:769] Sending connection context
0809 02:23:16.213481 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 02:23:16.213659 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":121,"threads_started":1}
I20260809 02:23:16.214571 32408 heartbeater.cc:347] Connected to a master server at 127.11.93.190:38207
I20260809 02:23:16.214704 32408 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:16.214927 32408 heartbeater.cc:511] Master 127.11.93.190:38207 requested a full tablet report, sending...
I20260809 02:23:16.215418 32050 ts_manager.cc:194] Registered new tserver with Master: 00f6ccd2a2664723b81114af652b5c4c (127.11.93.130:38349)
I20260809 02:23:16.215830 32050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.130@KRBTEST.COM'} at 127.11.93.130:52321
WARNING: no policy specified for kudu/127.11.93.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
Entry for principal kudu/127.11.93.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab.
I20260809 02:23:16.238562 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:38207
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:45429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:16.322402 32413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:16.322605 32413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:16.322628 32413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:16.324164 32413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:16.324209 32413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:16.324236 32413 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:23:16.325749 32413 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:45429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.131.keytab
--principal=kudu/127.11.93.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:38207
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32413
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:16.325994 32413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:16.326220 32413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:16.331316 32421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:16.331415 32413 server_base.cc:1034] running on GCE node
W20260809 02:23:16.331317 32419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:16.331342 32418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:16.331755 32413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:16.331950 32413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:16.333124 32413 hybrid_clock.cc:648] HybridClock initialized: now 1786242196333107 us; error 29 us; skew 500 ppm
Aug 09 02:23:16 dist-test-slave-w206 krb5kdc[32004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242196, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:16.335922 32413 init.cc:377] Logged in from keytab as kudu/127.11.93.131@KRBTEST.COM (short username kudu)
I20260809 02:23:16.336373 32413 webserver.cc:460] Webserver started at http://127.11.93.131:38507/ using document root <none> and password file <none>
I20260809 02:23:16.336599 32413 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:16.336644 32413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:16.336815 32413 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:16.337886 32413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "68694d4d11de40169765cf51242cc23b"
format_stamp: "Formatted at 2026-08-09 02:23:16 on dist-test-slave-w206"
server_key: "71ce4c8f90a6c84190c2b2d26c19380f"
server_key_iv: "8325ecdb148e72244e2cfc9ca37b375f"
server_key_version: "encryptionkey@0"
I20260809 02:23:16.338274 32413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "68694d4d11de40169765cf51242cc23b"
format_stamp: "Formatted at 2026-08-09 02:23:16 on dist-test-slave-w206"
server_key: "71ce4c8f90a6c84190c2b2d26c19380f"
server_key_iv: "8325ecdb148e72244e2cfc9ca37b375f"
server_key_version: "encryptionkey@0"
I20260809 02:23:16.339838 32413 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:23:16.340633 32428 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:16.340816 32413 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:23:16.340888 32413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "68694d4d11de40169765cf51242cc23b"
format_stamp: "Formatted at 2026-08-09 02:23:16 on dist-test-slave-w206"
server_key: "71ce4c8f90a6c84190c2b2d26c19380f"
server_key_iv: "8325ecdb148e72244e2cfc9ca37b375f"
server_key_version: "encryptionkey@0"
I20260809 02:23:16.340941 32413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:16.372152 32413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:16.374745 32413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:16.374882 32413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:16.375159 32413 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:16.375509 32413 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:16.375569 32413 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:16.375624 32413 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:16.375649 32413 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:16.381430 32413 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:34607
I20260809 02:23:16.381512 32549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:34607 every 8 connection(s)
I20260809 02:23:16.381860 32413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:23:16.384249 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 32413
I20260809 02:23:16.384370 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:23:16.384548 11638 external_mini_cluster.cc:1428] Setting key 5be466a5ba8ce26bbae898f846331225
Aug 09 02:23:16 dist-test-slave-w206 krb5kdc[32004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242196, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.131@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:23:16.391444 32096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:16.382675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:55475 (local address 127.11.93.190:38207)
0809 02:23:16.382750 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:16.382752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:16.382997 (+ 245us) server_negotiation.cc:407] Connection header received
0809 02:23:16.383549 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:16.383551 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:16.383563 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:16.383616 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:16.384649 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.385352 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.386365 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.386549 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.386601 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:16.388800 (+ 2199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:16.388802 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:16.388802 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:16.388808 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:16.390120 (+ 1312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:16.390504 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:16.390505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:16.390506 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:16.390556 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:16.390774 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:16.390774 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:16.390775 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:16.390889 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:16.390942 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:16.391310 (+ 368us) server_negotiation.cc:299] Negotiation successful
0809 02:23:16.391379 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:23:16.391680 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:16.382634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:38207 (local address 127.11.93.131:55475)
0809 02:23:16.382859 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:16.382897 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:16.383438 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:16.383692 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:16.383695 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:16.384272 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:16.384546 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:16.384552 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.385449 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.385450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:16.386287 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:16.386289 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.386626 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.386627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:16.386743 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:16.387264 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:16.387273 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:16.388718 (+ 1445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:16.390206 (+ 1488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:16.390212 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:16.390213 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:16.390436 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:16.390613 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:16.390613 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:16.390614 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:16.390720 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:16.391025 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:16.391033 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:16.391167 (+ 134us) client_negotiation.cc:769] Sending connection context
0809 02:23:16.391283 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 02:23:16.391412 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":115,"threads_started":1}
I20260809 02:23:16.392205 32552 heartbeater.cc:347] Connected to a master server at 127.11.93.190:38207
I20260809 02:23:16.392318 32552 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:16.392503 32552 heartbeater.cc:511] Master 127.11.93.190:38207 requested a full tablet report, sending...
I20260809 02:23:16.392905 32050 ts_manager.cc:194] Registered new tserver with Master: 68694d4d11de40169765cf51242cc23b (127.11.93.131:34607)
I20260809 02:23:16.393251 32050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.93.131@KRBTEST.COM'} at 127.11.93.131:55475
I20260809 02:23:16.396476 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:23:16.403967 32096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:16.397823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54382 (local address 127.11.93.190:38207)
0809 02:23:16.397917 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:16.397919 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:16.398032 (+ 113us) server_negotiation.cc:407] Connection header received
0809 02:23:16.398067 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:16.398068 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:16.398076 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:16.398123 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:16.398657 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.399221 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.399950 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.400127 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.400182 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:16.401433 (+ 1251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:16.401434 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:16.401434 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:16.401440 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:16.402801 (+ 1361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:16.403244 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:16.403245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:16.403246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:16.403302 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:16.403471 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:16.403471 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:16.403471 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:16.403609 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:16.403702 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:16.403820 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 02:23:16.403880 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 02:23:16.405665 32050 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54382:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:23:16.407423 32050 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:23:16.413699 32563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:16.409816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:40637 (local address 127.0.0.1:43792)
0809 02:23:16.410013 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:16.410060 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:16.410128 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:16.410377 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:16.410380 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:16.410382 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:16.410457 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:16.410459 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.411501 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.411502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:16.412493 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:16.412495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.413395 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.413396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:16.413488 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:16.413502 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 02:23:16.413575 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 02:23:16.413623 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":83,"threads_started":1}
I20260809 02:23:16.413741 32566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:16.409951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43792 (local address 127.11.93.129:40637)
0809 02:23:16.410187 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:16.410192 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:16.410203 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:23:16.410246 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:16.410248 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:16.410263 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:16.410362 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:16.410526 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.411389 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.412592 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.413301 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.413377 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:16.413441 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:16.413604 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 02:23:16.413648 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":88,"threads_started":1}
I20260809 02:23:16.414288 32569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:16.410046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:38349 (local address 127.0.0.1:41594)
0809 02:23:16.410560 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:16.410571 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:16.410628 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:16.410892 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:16.410892 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:16.410894 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:16.410928 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:16.410930 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.412180 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.412181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:16.413111 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:16.413113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.414062 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.414065 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:16.414115 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:16.414118 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:23:16.414186 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 02:23:16.414225 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"mutex_wait_us":41,"thread_start_us":69,"threads_started":1}
I20260809 02:23:16.414479 32565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:16.409860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:34607 (local address 127.0.0.1:50396)
0809 02:23:16.410122 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:16.410132 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:16.410233 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:16.410705 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:16.410706 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:16.410708 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:16.410758 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:16.410760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.412158 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.412159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:16.413368 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:16.413371 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.414229 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.414230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:16.414292 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:16.414297 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:23:16.414349 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 02:23:16.414396 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"mutex_wait_us":35,"thread_start_us":81,"threads_started":1}
I20260809 02:23:16.414479 32567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:16.409973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50396 (local address 127.11.93.131:34607)
0809 02:23:16.410516 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:16.410520 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:16.410531 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:23:16.410576 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:16.410578 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:16.410597 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:16.410834 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:16.410915 (+ 81us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.412036 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.413459 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.414147 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.414229 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:16.414282 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:16.414359 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 02:23:16.414396 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":82,"threads_started":1}
I20260809 02:23:16.414507 32570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:16.410260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41594 (local address 127.11.93.130:38349)
0809 02:23:16.410440 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:16.410445 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:16.410687 (+ 242us) server_negotiation.cc:407] Connection header received
0809 02:23:16.410732 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:16.410735 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:16.410750 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:16.410817 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:16.411031 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.412080 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.413197 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.413905 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.413977 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:16.414029 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:16.414392 (+ 363us) server_negotiation.cc:299] Negotiation successful
0809 02:23:16.414433 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":94,"threads_started":1}
I20260809 02:23:16.414633 32188 tablet_service.cc:1467] Processing CreateTablet for tablet 116d73a850434389bac2f61d54f4df33 (DEFAULT_TABLE table=test-table [id=1f48349942f24fe1b93a6f6701a0cce0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:16.415073 32188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 116d73a850434389bac2f61d54f4df33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:16.415211 32480 tablet_service.cc:1467] Processing CreateTablet for tablet 116d73a850434389bac2f61d54f4df33 (DEFAULT_TABLE table=test-table [id=1f48349942f24fe1b93a6f6701a0cce0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:16.415458 32480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 116d73a850434389bac2f61d54f4df33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:16.417524 32571 tablet_bootstrap.cc:492] T 116d73a850434389bac2f61d54f4df33 P 38e2042c0f2d4879951a63af5cfb9020: Bootstrap starting.
I20260809 02:23:16.417805 32572 tablet_bootstrap.cc:492] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b: Bootstrap starting.
I20260809 02:23:16.418200 32571 tablet_bootstrap.cc:654] T 116d73a850434389bac2f61d54f4df33 P 38e2042c0f2d4879951a63af5cfb9020: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:16.418375 32572 tablet_bootstrap.cc:654] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:16.418270 32335 tablet_service.cc:1467] Processing CreateTablet for tablet 116d73a850434389bac2f61d54f4df33 (DEFAULT_TABLE table=test-table [id=1f48349942f24fe1b93a6f6701a0cce0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:16.418622 32335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 116d73a850434389bac2f61d54f4df33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:16.418813 32572 log.cc:824] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:16.418816 32571 log.cc:824] T 116d73a850434389bac2f61d54f4df33 P 38e2042c0f2d4879951a63af5cfb9020: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:16.419541 32571 tablet_bootstrap.cc:492] T 116d73a850434389bac2f61d54f4df33 P 38e2042c0f2d4879951a63af5cfb9020: No bootstrap required, opened a new log
I20260809 02:23:16.419550 32572 tablet_bootstrap.cc:492] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b: No bootstrap required, opened a new log
I20260809 02:23:16.419606 32572 ts_tablet_manager.cc:1397] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:23:16.419606 32571 ts_tablet_manager.cc:1397] T 116d73a850434389bac2f61d54f4df33 P 38e2042c0f2d4879951a63af5cfb9020: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260809 02:23:16.421103 32575 tablet_bootstrap.cc:492] T 116d73a850434389bac2f61d54f4df33 P 00f6ccd2a2664723b81114af652b5c4c: Bootstrap starting.
I20260809 02:23:16.421559 32571 raft_consensus.cc:348] T 116d73a850434389bac2f61d54f4df33 P 38e2042c0f2d4879951a63af5cfb9020 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e2042c0f2d4879951a63af5cfb9020" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 40637 } } peers { permanent_uuid: "00f6ccd2a2664723b81114af652b5c4c" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 38349 } } peers { permanent_uuid: "68694d4d11de40169765cf51242cc23b" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 34607 } }
I20260809 02:23:16.421530 32572 raft_consensus.cc:348] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e2042c0f2d4879951a63af5cfb9020" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 40637 } } peers { permanent_uuid: "00f6ccd2a2664723b81114af652b5c4c" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 38349 } } peers { permanent_uuid: "68694d4d11de40169765cf51242cc23b" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 34607 } }
I20260809 02:23:16.421721 32572 raft_consensus.cc:374] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:16.421721 32571 raft_consensus.cc:374] T 116d73a850434389bac2f61d54f4df33 P 38e2042c0f2d4879951a63af5cfb9020 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:16.421747 32575 tablet_bootstrap.cc:654] T 116d73a850434389bac2f61d54f4df33 P 00f6ccd2a2664723b81114af652b5c4c: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:16.421769 32571 raft_consensus.cc:729] T 116d73a850434389bac2f61d54f4df33 P 38e2042c0f2d4879951a63af5cfb9020 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38e2042c0f2d4879951a63af5cfb9020, State: Initialized, Role: FOLLOWER
I20260809 02:23:16.421770 32572 raft_consensus.cc:729] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68694d4d11de40169765cf51242cc23b, State: Initialized, Role: FOLLOWER
I20260809 02:23:16.421886 32571 consensus_queue.cc:260] T 116d73a850434389bac2f61d54f4df33 P 38e2042c0f2d4879951a63af5cfb9020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e2042c0f2d4879951a63af5cfb9020" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 40637 } } peers { permanent_uuid: "00f6ccd2a2664723b81114af652b5c4c" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 38349 } } peers { permanent_uuid: "68694d4d11de40169765cf51242cc23b" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 34607 } }
I20260809 02:23:16.421917 32572 consensus_queue.cc:260] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e2042c0f2d4879951a63af5cfb9020" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 40637 } } peers { permanent_uuid: "00f6ccd2a2664723b81114af652b5c4c" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 38349 } } peers { permanent_uuid: "68694d4d11de40169765cf51242cc23b" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 34607 } }
I20260809 02:23:16.422171 32572 ts_tablet_manager.cc:1428] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 02:23:16.422184 32571 ts_tablet_manager.cc:1428] T 116d73a850434389bac2f61d54f4df33 P 38e2042c0f2d4879951a63af5cfb9020: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 02:23:16.422300 32552 heartbeater.cc:503] Master 127.11.93.190:38207 was elected leader, sending a full tablet report...
I20260809 02:23:16.422333 32575 log.cc:824] T 116d73a850434389bac2f61d54f4df33 P 00f6ccd2a2664723b81114af652b5c4c: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:16.422375 32262 heartbeater.cc:503] Master 127.11.93.190:38207 was elected leader, sending a full tablet report...
I20260809 02:23:16.423079 32575 tablet_bootstrap.cc:492] T 116d73a850434389bac2f61d54f4df33 P 00f6ccd2a2664723b81114af652b5c4c: No bootstrap required, opened a new log
I20260809 02:23:16.423154 32575 ts_tablet_manager.cc:1397] T 116d73a850434389bac2f61d54f4df33 P 00f6ccd2a2664723b81114af652b5c4c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:23:16.424750 32575 raft_consensus.cc:348] T 116d73a850434389bac2f61d54f4df33 P 00f6ccd2a2664723b81114af652b5c4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e2042c0f2d4879951a63af5cfb9020" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 40637 } } peers { permanent_uuid: "00f6ccd2a2664723b81114af652b5c4c" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 38349 } } peers { permanent_uuid: "68694d4d11de40169765cf51242cc23b" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 34607 } }
I20260809 02:23:16.424885 32575 raft_consensus.cc:374] T 116d73a850434389bac2f61d54f4df33 P 00f6ccd2a2664723b81114af652b5c4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:16.424907 32575 raft_consensus.cc:729] T 116d73a850434389bac2f61d54f4df33 P 00f6ccd2a2664723b81114af652b5c4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00f6ccd2a2664723b81114af652b5c4c, State: Initialized, Role: FOLLOWER
I20260809 02:23:16.424983 32575 consensus_queue.cc:260] T 116d73a850434389bac2f61d54f4df33 P 00f6ccd2a2664723b81114af652b5c4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e2042c0f2d4879951a63af5cfb9020" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 40637 } } peers { permanent_uuid: "00f6ccd2a2664723b81114af652b5c4c" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 38349 } } peers { permanent_uuid: "68694d4d11de40169765cf51242cc23b" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 34607 } }
I20260809 02:23:16.425175 32575 ts_tablet_manager.cc:1428] T 116d73a850434389bac2f61d54f4df33 P 00f6ccd2a2664723b81114af652b5c4c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:23:16.425307 32408 heartbeater.cc:503] Master 127.11.93.190:38207 was elected leader, sending a full tablet report...
W20260809 02:23:16.453830 32409 tablet.cc:2369] T 116d73a850434389bac2f61d54f4df33 P 00f6ccd2a2664723b81114af652b5c4c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:23:16.522181 32263 tablet.cc:2369] T 116d73a850434389bac2f61d54f4df33 P 38e2042c0f2d4879951a63af5cfb9020: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:23:16.585899 32577 raft_consensus.cc:482] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:23:16.586027 32577 raft_consensus.cc:504] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e2042c0f2d4879951a63af5cfb9020" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 40637 } } peers { permanent_uuid: "00f6ccd2a2664723b81114af652b5c4c" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 38349 } } peers { permanent_uuid: "68694d4d11de40169765cf51242cc23b" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 34607 } }
I20260809 02:23:16.586382 32577 leader_election.cc:288] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38e2042c0f2d4879951a63af5cfb9020 (127.11.93.129:40637), 00f6ccd2a2664723b81114af652b5c4c (127.11.93.130:38349)
I20260809 02:23:16.589257 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:16.586594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:40637 (local address 127.11.93.131:53759)
0809 02:23:16.586663 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:16.586678 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:16.586771 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:16.586968 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:16.586969 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:16.586990 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:16.587065 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:16.587067 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.587692 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.587693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:16.588448 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:16.588450 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.588983 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.588984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:16.589072 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:16.589074 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 02:23:16.589140 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 02:23:16.589182 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":4}
I20260809 02:23:16.589257 32566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:16.586686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:53759 (local address 127.11.93.129:40637)
0809 02:23:16.586734 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:16.586736 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:16.586748 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:23:16.586862 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:16.586864 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:16.586875 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:16.586964 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:16.587131 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.587602 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.588542 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.588896 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.588987 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:16.588995 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:16.589146 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 02:23:16.589182 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 02:23:16.589412 32570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:16.586824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:50509 (local address 127.11.93.130:38349)
0809 02:23:16.586874 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:16.586876 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:16.586995 (+ 119us) server_negotiation.cc:407] Connection header received
0809 02:23:16.587053 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:16.587054 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:16.587062 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:16.587139 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:16.587307 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.587757 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.588686 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.589061 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.589146 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:16.589154 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:16.589308 (+ 154us) server_negotiation.cc:299] Negotiation successful
0809 02:23:16.589347 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 02:23:16.589421 32580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:16.586731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:38349 (local address 127.11.93.131:50509)
0809 02:23:16.586898 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:16.586907 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:16.586979 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:16.587142 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:16.587142 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:16.587144 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:16.587224 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:16.587225 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.587846 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.587847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:16.588592 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:16.588594 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.589159 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.589160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:16.589233 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:16.589236 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:23:16.589303 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 02:23:16.589340 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":99,"threads_started":1}
I20260809 02:23:16.589630 32209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "116d73a850434389bac2f61d54f4df33" candidate_uuid: "68694d4d11de40169765cf51242cc23b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38e2042c0f2d4879951a63af5cfb9020" is_pre_election: true
I20260809 02:23:16.589811 32209 raft_consensus.cc:2454] T 116d73a850434389bac2f61d54f4df33 P 38e2042c0f2d4879951a63af5cfb9020 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68694d4d11de40169765cf51242cc23b in term 0.
I20260809 02:23:16.590111 32430 leader_election.cc:302] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38e2042c0f2d4879951a63af5cfb9020, 68694d4d11de40169765cf51242cc23b; no voters:
I20260809 02:23:16.590250 32577 raft_consensus.cc:2781] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:23:16.590201 32357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "116d73a850434389bac2f61d54f4df33" candidate_uuid: "68694d4d11de40169765cf51242cc23b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00f6ccd2a2664723b81114af652b5c4c" is_pre_election: true
I20260809 02:23:16.590327 32577 raft_consensus.cc:482] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:23:16.590368 32577 raft_consensus.cc:3037] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:16.590387 32357 raft_consensus.cc:2454] T 116d73a850434389bac2f61d54f4df33 P 00f6ccd2a2664723b81114af652b5c4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68694d4d11de40169765cf51242cc23b in term 0.
I20260809 02:23:16.591282 32577 raft_consensus.cc:504] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e2042c0f2d4879951a63af5cfb9020" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 40637 } } peers { permanent_uuid: "00f6ccd2a2664723b81114af652b5c4c" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 38349 } } peers { permanent_uuid: "68694d4d11de40169765cf51242cc23b" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 34607 } }
I20260809 02:23:16.591568 32577 leader_election.cc:288] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b [CANDIDATE]: Term 1 election: Requested vote from peers 38e2042c0f2d4879951a63af5cfb9020 (127.11.93.129:40637), 00f6ccd2a2664723b81114af652b5c4c (127.11.93.130:38349)
I20260809 02:23:16.591781 32209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "116d73a850434389bac2f61d54f4df33" candidate_uuid: "68694d4d11de40169765cf51242cc23b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38e2042c0f2d4879951a63af5cfb9020"
I20260809 02:23:16.591811 32357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "116d73a850434389bac2f61d54f4df33" candidate_uuid: "68694d4d11de40169765cf51242cc23b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00f6ccd2a2664723b81114af652b5c4c"
I20260809 02:23:16.591877 32357 raft_consensus.cc:3037] T 116d73a850434389bac2f61d54f4df33 P 00f6ccd2a2664723b81114af652b5c4c [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:16.591878 32209 raft_consensus.cc:3037] T 116d73a850434389bac2f61d54f4df33 P 38e2042c0f2d4879951a63af5cfb9020 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:16.592774 32209 raft_consensus.cc:2454] T 116d73a850434389bac2f61d54f4df33 P 38e2042c0f2d4879951a63af5cfb9020 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68694d4d11de40169765cf51242cc23b in term 1.
I20260809 02:23:16.592818 32357 raft_consensus.cc:2454] T 116d73a850434389bac2f61d54f4df33 P 00f6ccd2a2664723b81114af652b5c4c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68694d4d11de40169765cf51242cc23b in term 1.
I20260809 02:23:16.592924 32430 leader_election.cc:302] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38e2042c0f2d4879951a63af5cfb9020, 68694d4d11de40169765cf51242cc23b; no voters:
I20260809 02:23:16.593012 32577 raft_consensus.cc:2781] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:16.593160 32577 raft_consensus.cc:686] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b [term 1 LEADER]: Becoming Leader. State: Replica: 68694d4d11de40169765cf51242cc23b, State: Running, Role: LEADER
I20260809 02:23:16.593253 32577 consensus_queue.cc:237] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e2042c0f2d4879951a63af5cfb9020" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 40637 } } peers { permanent_uuid: "00f6ccd2a2664723b81114af652b5c4c" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 38349 } } peers { permanent_uuid: "68694d4d11de40169765cf51242cc23b" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 34607 } }
I20260809 02:23:16.594224 32048 catalog_manager.cc:5495] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b reported cstate change: term changed from 0 to 1, leader changed from <none> to 68694d4d11de40169765cf51242cc23b (127.11.93.131). New cstate: current_term: 1 leader_uuid: "68694d4d11de40169765cf51242cc23b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38e2042c0f2d4879951a63af5cfb9020" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 40637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00f6ccd2a2664723b81114af652b5c4c" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 38349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68694d4d11de40169765cf51242cc23b" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 34607 } health_report { overall_health: HEALTHY } } }
W20260809 02:23:16.632431 32553 tablet.cc:2369] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:23:16.641212 32567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:16.638713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50398 (local address 127.11.93.131:34607)
0809 02:23:16.638764 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:16.638766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:16.638774 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:23:16.638847 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:16.638848 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:16.638873 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:16.638964 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:16.639144 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.639622 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.640407 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.640606 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.640681 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:16.640844 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:16.640960 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:16.641055 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:16.641073 (+ 18us) server_negotiation.cc:299] Negotiation successful
0809 02:23:16.641095 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 02:23:16.643149 32209 raft_consensus.cc:1261] T 116d73a850434389bac2f61d54f4df33 P 38e2042c0f2d4879951a63af5cfb9020 [term 1 FOLLOWER]: Refusing update from remote peer 68694d4d11de40169765cf51242cc23b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:16.643143 32357 raft_consensus.cc:1261] T 116d73a850434389bac2f61d54f4df33 P 00f6ccd2a2664723b81114af652b5c4c [term 1 FOLLOWER]: Refusing update from remote peer 68694d4d11de40169765cf51242cc23b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:16.643517 32577 consensus_queue.cc:1035] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b [LEADER]: Connected to new peer: Peer: permanent_uuid: "38e2042c0f2d4879951a63af5cfb9020" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 40637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:16.643704 32581 consensus_queue.cc:1035] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b [LEADER]: Connected to new peer: Peer: permanent_uuid: "00f6ccd2a2664723b81114af652b5c4c" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 38349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:16.646180 32584 mvcc.cc:205] Tried to move back new op lower bound from 7316448037447299072 to 7316448037246705664. Current Snapshot: MvccSnapshot[applied={T|T < 7316448037447299072}]
I20260809 02:23:16.646368 32585 mvcc.cc:205] Tried to move back new op lower bound from 7316448037447299072 to 7316448037246705664. Current Snapshot: MvccSnapshot[applied={T|T < 7316448037447299072}]
I20260809 02:23:16.649292 32048 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54382:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:23:16.649382 32048 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54382:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:23:16.650216 32048 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 32394d4f3e7b4242877f133ce6a96a5b: Sending DeleteTablet for 3 replicas of tablet 116d73a850434389bac2f61d54f4df33
I20260809 02:23:16.650564 32480 tablet_service.cc:1514] Processing DeleteTablet for tablet 116d73a850434389bac2f61d54f4df33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:16 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:50396
I20260809 02:23:16.650591 32335 tablet_service.cc:1514] Processing DeleteTablet for tablet 116d73a850434389bac2f61d54f4df33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:16 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:41594
I20260809 02:23:16.650655 32188 tablet_service.cc:1514] Processing DeleteTablet for tablet 116d73a850434389bac2f61d54f4df33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:16 UTC) from {username='kudu', principal='kudu/127.11.93.190@KRBTEST.COM'} at 127.0.0.1:43792
I20260809 02:23:16.650870 32597 tablet_replica.cc:330] T 116d73a850434389bac2f61d54f4df33 P 38e2042c0f2d4879951a63af5cfb9020: stopping tablet replica
I20260809 02:23:16.651027 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 32120
W20260809 02:23:16.657477 32034 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.93.129:40637 (error 108)
I20260809 02:23:16.657627 32595 tablet_replica.cc:330] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b: stopping tablet replica
I20260809 02:23:16.657748 32595 raft_consensus.cc:2229] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:23:16.657898 32595 raft_consensus.cc:2258] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:23:16.658064 32596 tablet_replica.cc:330] T 116d73a850434389bac2f61d54f4df33 P 00f6ccd2a2664723b81114af652b5c4c: stopping tablet replica
I20260809 02:23:16.658140 32565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:16.658013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:40637 (local address 127.0.0.1:43800)
0809 02:23:16.658069 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:16.658108 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.129:40637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 02:23:16.658188 32596 raft_consensus.cc:2229] T 116d73a850434389bac2f61d54f4df33 P 00f6ccd2a2664723b81114af652b5c4c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260809 02:23:16.658241 32034 catalog_manager.cc:4584] TS 38e2042c0f2d4879951a63af5cfb9020 (127.11.93.129:40637): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 116d73a850434389bac2f61d54f4df33: Network error: Client connection negotiation failed: client connection to 127.11.93.129:40637: connect: Connection refused (error 111)
I20260809 02:23:16.658300 32596 raft_consensus.cc:2258] T 116d73a850434389bac2f61d54f4df33 P 00f6ccd2a2664723b81114af652b5c4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:23:16.658555 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 32267
I20260809 02:23:16.658839 32595 ts_tablet_manager.cc:1905] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:23:16.658955 32596 ts_tablet_manager.cc:1905] T 116d73a850434389bac2f61d54f4df33 P 00f6ccd2a2664723b81114af652b5c4c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:23:16.661264 32595 ts_tablet_manager.cc:1918] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:23:16.661403 32595 log.cc:1196] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/116d73a850434389bac2f61d54f4df33
I20260809 02:23:16.661764 32595 ts_tablet_manager.cc:1939] T 116d73a850434389bac2f61d54f4df33 P 68694d4d11de40169765cf51242cc23b: Deleting consensus metadata
I20260809 02:23:16.665829 32035 catalog_manager.cc:4841] TS 68694d4d11de40169765cf51242cc23b (127.11.93.131:34607): tablet 116d73a850434389bac2f61d54f4df33 (table test-table [id=1f48349942f24fe1b93a6f6701a0cce0]) successfully deleted
I20260809 02:23:16.665985 32565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:16.665875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:38349 (local address 127.0.0.1:41610)
0809 02:23:16.665922 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:16.665945 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.130:38349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260809 02:23:16.666153 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 32413
I20260809 02:23:16.673173 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 32017
2026-08-09T02:23:16Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2168 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-09T02:23:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:16Z Disabled control of system clock
I20260809 02:23:16.703222 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:41841
--webserver_interface=127.11.93.190
--webserver_port=0
--builtin_ntp_servers=127.11.93.148:43959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:41841
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:23:16.784911 32602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:16.785122 32602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:16.785142 32602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:16.786201 32602 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:16.786233 32602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:16.786247 32602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:16.786259 32602 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:16.786271 32602 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:16.787593 32602 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:43959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:41841
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:41841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:16.787781 32602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:16.788008 32602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:16.792903 32612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:16.792958 32610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:16.793002 32602 server_base.cc:1034] running on GCE node
W20260809 02:23:16.792914 32609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:16.793345 32602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:16.793648 32602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:16.794811 32602 hybrid_clock.cc:648] HybridClock initialized: now 1786242196794816 us; error 52 us; skew 500 ppm
I20260809 02:23:16.796177 32602 webserver.cc:460] Webserver started at http://127.11.93.190:32999/ using document root <none> and password file <none>
I20260809 02:23:16.796428 32602 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:16.796500 32602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:16.796631 32602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:16.797673 32602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "72438e128d7743a5b358c510ce70ffb9"
format_stamp: "Formatted at 2026-08-09 02:23:16 on dist-test-slave-w206"
server_key: "c5b1c5f89f6da411b6feac341b57847d"
server_key_iv: "b36e29c500c22d540439122e98d340ea"
server_key_version: "encryptionkey@0"
I20260809 02:23:16.798048 32602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "72438e128d7743a5b358c510ce70ffb9"
format_stamp: "Formatted at 2026-08-09 02:23:16 on dist-test-slave-w206"
server_key: "c5b1c5f89f6da411b6feac341b57847d"
server_key_iv: "b36e29c500c22d540439122e98d340ea"
server_key_version: "encryptionkey@0"
I20260809 02:23:16.799468 32602 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260809 02:23:16.800351 32618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:16.800575 32602 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:16.800683 32602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "72438e128d7743a5b358c510ce70ffb9"
format_stamp: "Formatted at 2026-08-09 02:23:16 on dist-test-slave-w206"
server_key: "c5b1c5f89f6da411b6feac341b57847d"
server_key_iv: "b36e29c500c22d540439122e98d340ea"
server_key_version: "encryptionkey@0"
I20260809 02:23:16.800756 32602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:16.811873 32602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:16.812197 32602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:16.812356 32602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:16.816745 32602 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:41841
I20260809 02:23:16.816787 32676 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:41841 every 8 connection(s)
I20260809 02:23:16.817142 32602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:16.817613 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 32602
I20260809 02:23:16.817700 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:16.817910 11638 external_mini_cluster.cc:1428] Setting key ef9befd2b5478e3b9cd4861e317dae57
I20260809 02:23:16.818425 32677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:16.821753 32677 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9: Bootstrap starting.
I20260809 02:23:16.822491 32677 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:16.822803 32677 log.cc:824] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:16.823530 32677 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9: No bootstrap required, opened a new log
I20260809 02:23:16.824049 32680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:16.818477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56276 (local address 127.11.93.190:41841)
0809 02:23:16.818721 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:16.818730 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:16.818763 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:23:16.819337 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:16.819347 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:16.819428 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:16.819574 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:16.819740 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.821074 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.821820 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.822427 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.822560 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:16.823362 (+ 802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:16.823366 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:16.823366 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:16.823534 (+ 168us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:16.823567 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:16.823578 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:16.823658 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:16.823789 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 02:23:16.823872 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":108,"threads_started":1}
I20260809 02:23:16.825608 32677 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72438e128d7743a5b358c510ce70ffb9" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41841 } }
I20260809 02:23:16.825771 32677 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:16.825819 32677 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72438e128d7743a5b358c510ce70ffb9, State: Initialized, Role: FOLLOWER
I20260809 02:23:16.825944 32677 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72438e128d7743a5b358c510ce70ffb9" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41841 } }
I20260809 02:23:16.826028 32677 raft_consensus.cc:388] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:16.826071 32677 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:16.826119 32677 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:16.826663 32677 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72438e128d7743a5b358c510ce70ffb9" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41841 } }
I20260809 02:23:16.826783 32677 leader_election.cc:302] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72438e128d7743a5b358c510ce70ffb9; no voters:
I20260809 02:23:16.827018 32677 leader_election.cc:288] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:16.827041 32683 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:16.827209 32683 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9 [term 1 LEADER]: Becoming Leader. State: Replica: 72438e128d7743a5b358c510ce70ffb9, State: Running, Role: LEADER
I20260809 02:23:16.827299 32683 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72438e128d7743a5b358c510ce70ffb9" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41841 } }
I20260809 02:23:16.827314 32677 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:16.827639 32684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72438e128d7743a5b358c510ce70ffb9. Latest consensus state: current_term: 1 leader_uuid: "72438e128d7743a5b358c510ce70ffb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72438e128d7743a5b358c510ce70ffb9" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41841 } } }
I20260809 02:23:16.827646 32686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72438e128d7743a5b358c510ce70ffb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72438e128d7743a5b358c510ce70ffb9" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41841 } } }
I20260809 02:23:16.827864 32684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:16.827881 32686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:16.828343 32693 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:16.828886 32693 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:16.830425 32693 catalog_manager.cc:1347] Generated new cluster ID: 4af1999dcff7418e9015b433b06ce3fc
I20260809 02:23:16.830468 32693 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:16.851366 32693 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:16.852109 32693 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:16.866146 32693 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9: Generated new TSK 0
I20260809 02:23:16.866369 32693 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:16.871232 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.129:0
--local_ip_for_outbound_sockets=127.11.93.129
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:41841
--builtin_ntp_servers=127.11.93.148:43959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:23:16.957981 32707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:16.958204 32707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:16.958228 32707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:16.959417 32707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:16.959460 32707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:16.959484 32707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.129
I20260809 02:23:16.960851 32707 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:43959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.93.129
--webserver_port=0
--tserver_master_addrs=127.11.93.190:41841
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.129
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:16.961117 32707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:16.961440 32707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:16.966547 32712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:16.966569 32713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:16.966542 32715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:16.966732 32707 server_base.cc:1034] running on GCE node
I20260809 02:23:16.966948 32707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:16.967218 32707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:16.968396 32707 hybrid_clock.cc:648] HybridClock initialized: now 1786242196968377 us; error 32 us; skew 500 ppm
I20260809 02:23:16.969693 32707 webserver.cc:460] Webserver started at http://127.11.93.129:35841/ using document root <none> and password file <none>
I20260809 02:23:16.969972 32707 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:16.970045 32707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:16.970201 32707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:16.971377 32707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-0/data/instance:
uuid: "8d79e2da22a4434eb774c79f256f1f4b"
format_stamp: "Formatted at 2026-08-09 02:23:16 on dist-test-slave-w206"
server_key: "482e432f0e8568760083758678cfd8c6"
server_key_iv: "d913bad895987334b6614ee1f7f4174f"
server_key_version: "encryptionkey@0"
I20260809 02:23:16.971742 32707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance:
uuid: "8d79e2da22a4434eb774c79f256f1f4b"
format_stamp: "Formatted at 2026-08-09 02:23:16 on dist-test-slave-w206"
server_key: "482e432f0e8568760083758678cfd8c6"
server_key_iv: "d913bad895987334b6614ee1f7f4174f"
server_key_version: "encryptionkey@0"
I20260809 02:23:16.973063 32707 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:23:16.973774 32721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:16.973942 32707 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:23:16.974042 32707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-0/wal
uuid: "8d79e2da22a4434eb774c79f256f1f4b"
format_stamp: "Formatted at 2026-08-09 02:23:16 on dist-test-slave-w206"
server_key: "482e432f0e8568760083758678cfd8c6"
server_key_iv: "d913bad895987334b6614ee1f7f4174f"
server_key_version: "encryptionkey@0"
I20260809 02:23:16.974123 32707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:16.983192 32707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:16.983506 32707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:16.983659 32707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:16.983886 32707 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:16.984226 32707 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:16.984288 32707 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:16.984329 32707 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:16.984357 32707 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:16.990185 32707 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.129:46005
I20260809 02:23:16.990260 375 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.129:46005 every 8 connection(s)
I20260809 02:23:16.990604 32707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-0/data/info.pb
I20260809 02:23:16.996194 32680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:16.991452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.129:49903 (local address 127.11.93.190:41841)
0809 02:23:16.991538 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:16.991540 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:16.991783 (+ 243us) server_negotiation.cc:407] Connection header received
0809 02:23:16.992285 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:16.992286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:16.992302 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:16.992406 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:16.993112 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.993667 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.994638 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.994866 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.994929 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:16.995831 (+ 902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:16.995832 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:16.995833 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:16.995854 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:16.995870 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:16.995874 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:16.995952 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:16.996095 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 02:23:16.996132 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 02:23:16.996259 378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:16.991436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:41841 (local address 127.11.93.129:49903)
0809 02:23:16.991642 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:16.991688 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:16.992169 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:16.992459 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:16.992462 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:16.992470 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:16.993016 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:16.993020 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.993755 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.993756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:16.994550 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:16.994551 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:16.994949 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:16.994950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:16.995076 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:16.995656 (+ 580us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:23:16.995658 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:16.995692 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:23:16.995716 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:16.995955 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:16.995960 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:16.995962 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 02:23:16.996017 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 02:23:16.996101 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":90,"threads_started":1}
I20260809 02:23:16.997014 376 heartbeater.cc:347] Connected to a master server at 127.11.93.190:41841
I20260809 02:23:16.997035 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 32707
I20260809 02:23:16.997128 376 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:16.997149 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-0/wal/instance
I20260809 02:23:16.997324 376 heartbeater.cc:511] Master 127.11.93.190:41841 requested a full tablet report, sending...
I20260809 02:23:16.997349 11638 external_mini_cluster.cc:1428] Setting key 6204690524af425c2aa95fac52e5f2ec
I20260809 02:23:16.997906 32635 ts_manager.cc:194] Registered new tserver with Master: 8d79e2da22a4434eb774c79f256f1f4b (127.11.93.129:46005)
I20260809 02:23:16.998495 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.130:0
--local_ip_for_outbound_sockets=127.11.93.130
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:41841
--builtin_ntp_servers=127.11.93.148:43959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 02:23:16.998600 32635 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.93.129:49903
W20260809 02:23:17.083032 379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:17.083259 379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:17.083283 379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:17.084404 379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:17.084440 379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:17.084465 379 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.130
I20260809 02:23:17.085731 379 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:43959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.93.130
--webserver_port=0
--tserver_master_addrs=127.11.93.190:41841
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.379
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.130
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:17.085956 379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:17.086233 379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:17.091466 387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:17.091602 379 server_base.cc:1034] running on GCE node
W20260809 02:23:17.091681 385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:17.091464 389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:17.092077 379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:17.092332 379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:17.093502 379 hybrid_clock.cc:648] HybridClock initialized: now 1786242197093486 us; error 39 us; skew 500 ppm
I20260809 02:23:17.095009 379 webserver.cc:460] Webserver started at http://127.11.93.130:45277/ using document root <none> and password file <none>
I20260809 02:23:17.095249 379 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:17.095319 379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:17.095489 379 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:17.096581 379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-1/data/instance:
uuid: "6c6bf22125b6454da3548f6c2e35f85d"
format_stamp: "Formatted at 2026-08-09 02:23:17 on dist-test-slave-w206"
server_key: "ec4c51387538f9f8ffc3cca718e1bcce"
server_key_iv: "6aa9e523fd7e8cbe57cf0a45d135a03a"
server_key_version: "encryptionkey@0"
I20260809 02:23:17.096953 379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance:
uuid: "6c6bf22125b6454da3548f6c2e35f85d"
format_stamp: "Formatted at 2026-08-09 02:23:17 on dist-test-slave-w206"
server_key: "ec4c51387538f9f8ffc3cca718e1bcce"
server_key_iv: "6aa9e523fd7e8cbe57cf0a45d135a03a"
server_key_version: "encryptionkey@0"
I20260809 02:23:17.098295 379 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:23:17.099108 395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:17.099332 379 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:17.099443 379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-1/wal
uuid: "6c6bf22125b6454da3548f6c2e35f85d"
format_stamp: "Formatted at 2026-08-09 02:23:17 on dist-test-slave-w206"
server_key: "ec4c51387538f9f8ffc3cca718e1bcce"
server_key_iv: "6aa9e523fd7e8cbe57cf0a45d135a03a"
server_key_version: "encryptionkey@0"
I20260809 02:23:17.099534 379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:17.125301 379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:17.125646 379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:17.125802 379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:17.126041 379 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:17.126410 379 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:17.126466 379 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:17.126507 379 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:17.126534 379 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:17.132583 379 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.130:40127
I20260809 02:23:17.132660 514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.130:40127 every 8 connection(s)
I20260809 02:23:17.133003 379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-1/data/info.pb
I20260809 02:23:17.134476 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 379
I20260809 02:23:17.134603 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-1/wal/instance
I20260809 02:23:17.134819 11638 external_mini_cluster.cc:1428] Setting key c6667b125f12d3d2d5e9e68d32cb96e4
I20260809 02:23:17.135929 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.93.131:0
--local_ip_for_outbound_sockets=127.11.93.131
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:41841
--builtin_ntp_servers=127.11.93.148:43959
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 02:23:17.138948 32680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.133756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:56595 (local address 127.11.93.190:41841)
0809 02:23:17.133827 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:17.133829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:17.134052 (+ 223us) server_negotiation.cc:407] Connection header received
0809 02:23:17.134623 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:17.134625 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:17.134640 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:17.134706 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:17.135560 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.136299 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.137316 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.137632 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.137700 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:17.138689 (+ 989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:17.138690 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:17.138691 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:17.138696 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:17.138713 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:17.138717 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:17.138766 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:17.138834 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 02:23:17.138868 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 02:23:17.139204 517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.133756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:41841 (local address 127.11.93.130:56595)
0809 02:23:17.133929 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:17.133962 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:17.134482 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:17.134781 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:17.134784 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:17.134793 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:17.135458 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:17.135484 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.136390 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.136391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:17.137225 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:17.137228 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.137724 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.137725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:17.137880 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:17.138545 (+ 665us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:23:17.138546 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:17.138575 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:23:17.138598 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:17.138766 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:17.138771 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:17.138774 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:23:17.138839 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 02:23:17.138944 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":72,"threads_started":1}
I20260809 02:23:17.139732 515 heartbeater.cc:347] Connected to a master server at 127.11.93.190:41841
I20260809 02:23:17.139842 515 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:17.140040 515 heartbeater.cc:511] Master 127.11.93.190:41841 requested a full tablet report, sending...
I20260809 02:23:17.140452 32635 ts_manager.cc:194] Registered new tserver with Master: 6c6bf22125b6454da3548f6c2e35f85d (127.11.93.130:40127)
I20260809 02:23:17.141003 32635 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.93.130:56595
W20260809 02:23:17.219306 518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:17.219530 518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:17.219553 518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:17.220667 518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:17.220705 518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:17.220729 518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.93.131
I20260809 02:23:17.222035 518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:43959
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.93.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.93.131
--webserver_port=0
--tserver_master_addrs=127.11.93.190:41841
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.93.131
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:17.222224 518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:17.222478 518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:17.227509 528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:17.227581 524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:17.227656 526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:17.227883 518 server_base.cc:1034] running on GCE node
I20260809 02:23:17.228077 518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:17.228432 518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:17.229573 518 hybrid_clock.cc:648] HybridClock initialized: now 1786242197229563 us; error 27 us; skew 500 ppm
I20260809 02:23:17.230823 518 webserver.cc:460] Webserver started at http://127.11.93.131:41457/ using document root <none> and password file <none>
I20260809 02:23:17.231156 518 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:17.231235 518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:17.231386 518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:17.232492 518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-2/data/instance:
uuid: "8bcce975ea1b422dac8aa1a091ea7312"
format_stamp: "Formatted at 2026-08-09 02:23:17 on dist-test-slave-w206"
server_key: "4506179961bf1b8f3f20f8797e1c78c7"
server_key_iv: "705b81de83be10a757ee00cb964abfda"
server_key_version: "encryptionkey@0"
I20260809 02:23:17.232863 518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance:
uuid: "8bcce975ea1b422dac8aa1a091ea7312"
format_stamp: "Formatted at 2026-08-09 02:23:17 on dist-test-slave-w206"
server_key: "4506179961bf1b8f3f20f8797e1c78c7"
server_key_iv: "705b81de83be10a757ee00cb964abfda"
server_key_version: "encryptionkey@0"
I20260809 02:23:17.234181 518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:23:17.234946 534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:17.235167 518 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:17.235265 518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-2/wal
uuid: "8bcce975ea1b422dac8aa1a091ea7312"
format_stamp: "Formatted at 2026-08-09 02:23:17 on dist-test-slave-w206"
server_key: "4506179961bf1b8f3f20f8797e1c78c7"
server_key_iv: "705b81de83be10a757ee00cb964abfda"
server_key_version: "encryptionkey@0"
I20260809 02:23:17.235371 518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:17.245131 518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:17.245441 518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:17.245592 518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:17.245820 518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:23:17.246148 518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:23:17.246202 518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:17.246244 518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:23:17.246272 518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:17.252288 518 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.131:38031
I20260809 02:23:17.252367 653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.131:38031 every 8 connection(s)
I20260809 02:23:17.252712 518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-2/data/info.pb
I20260809 02:23:17.257678 32680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.253465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.131:51893 (local address 127.11.93.190:41841)
0809 02:23:17.253539 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:17.253541 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:17.253783 (+ 242us) server_negotiation.cc:407] Connection header received
0809 02:23:17.254253 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:17.254254 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:17.254263 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:17.254356 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:17.255038 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.255560 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.256487 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.256660 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.256709 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:17.257457 (+ 748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:17.257459 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:17.257459 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:17.257463 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:17.257477 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:17.257480 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:17.257522 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:17.257600 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 02:23:17.257619 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:23:17.257872 656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.253452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:41841 (local address 127.11.93.131:51893)
0809 02:23:17.253653 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:17.253693 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:17.254175 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:17.254443 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:17.254447 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:17.254455 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:17.254932 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:17.254936 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.255636 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.255637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:17.256415 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:17.256417 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.256728 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.256729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:17.256834 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:17.257320 (+ 486us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:23:17.257321 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:17.257347 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:23:17.257382 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:17.257533 (+ 151us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:17.257537 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:17.257539 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 02:23:17.257589 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 02:23:17.257666 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":108,"threads_started":1}
I20260809 02:23:17.258373 654 heartbeater.cc:347] Connected to a master server at 127.11.93.190:41841
I20260809 02:23:17.258472 654 heartbeater.cc:464] Registering TS with master...
I20260809 02:23:17.258620 654 heartbeater.cc:511] Master 127.11.93.190:41841 requested a full tablet report, sending...
I20260809 02:23:17.259027 32635 ts_manager.cc:194] Registered new tserver with Master: 8bcce975ea1b422dac8aa1a091ea7312 (127.11.93.131:38031)
I20260809 02:23:17.259420 32635 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.93.131:51893
I20260809 02:23:17.262027 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 518
I20260809 02:23:17.262168 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-2/wal/instance
I20260809 02:23:17.262384 11638 external_mini_cluster.cc:1428] Setting key 6f2c3db34b9531a5150ad253543652ed
I20260809 02:23:17.263382 11638 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:23:17.267745 32680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.264782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56278 (local address 127.11.93.190:41841)
0809 02:23:17.264846 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:17.264855 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:17.264980 (+ 125us) server_negotiation.cc:407] Connection header received
0809 02:23:17.265046 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:17.265047 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:17.265057 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:17.265112 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:17.265286 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.265749 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.266519 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.266714 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.266796 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:17.267515 (+ 719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:17.267517 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:17.267517 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:17.267521 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:17.267535 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:17.267539 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:17.267588 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:17.267641 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 02:23:17.267663 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:23:17.269418 32635 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56278:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:23:17.270964 32635 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:23:17.277671 664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.273391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:46005 (local address 127.0.0.1:47922)
0809 02:23:17.273809 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:17.273819 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:17.273858 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:17.274130 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:17.274131 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:17.274133 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:17.274180 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:17.274182 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.275494 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.275495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:17.276566 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:17.276568 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.277379 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.277380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:17.277457 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:17.277469 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 02:23:17.277545 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 02:23:17.277596 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"mutex_wait_us":32,"thread_start_us":75,"threads_started":1}
I20260809 02:23:17.277815 663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.273388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:40127 (local address 127.0.0.1:46290)
0809 02:23:17.273578 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:17.273619 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:17.273689 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:17.274049 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:17.274052 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:17.274055 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:17.274125 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:17.274128 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.275198 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.275199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:17.276448 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:17.276451 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.277548 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.277549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:17.277625 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:17.277629 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:23:17.277681 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 02:23:17.277732 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":1,"thread_start_us":105,"threads_started":1}
I20260809 02:23:17.277835 666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.273567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35322 (local address 127.11.93.131:38031)
0809 02:23:17.274187 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:17.274191 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:17.274201 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:23:17.274236 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:17.274238 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:17.274254 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:17.274324 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:17.274511 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.275588 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.276692 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.277382 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.277440 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:17.277510 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:17.277725 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 02:23:17.277762 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":578,"thread_start_us":90,"threads_started":1}
I20260809 02:23:17.278021 665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.273391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:38031 (local address 127.0.0.1:35322)
0809 02:23:17.273938 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:17.273947 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:17.273983 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:17.274387 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:17.274388 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:17.274390 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:17.274427 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:17.274428 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.275668 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.275670 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:17.276600 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:17.276603 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.277551 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.277551 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:17.277631 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:17.277635 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:23:17.277681 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 02:23:17.277961 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"mutex_wait_us":275,"thread_start_us":104,"threads_started":1}
I20260809 02:23:17.278131 668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.273674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46290 (local address 127.11.93.130:40127)
0809 02:23:17.273885 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:17.273889 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:17.273898 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:23:17.273930 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:17.273931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:17.273943 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:17.274059 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:17.274216 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.275119 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.276537 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.277345 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.277422 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:17.277510 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:17.278001 (+ 491us) server_negotiation.cc:299] Negotiation successful
0809 02:23:17.278047 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":86,"threads_started":1}
I20260809 02:23:17.277680 667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.273641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47922 (local address 127.11.93.129:46005)
0809 02:23:17.273834 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:17.273839 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:17.273850 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:23:17.273938 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:17.273940 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:17.273959 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:17.274048 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:17.274260 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.275408 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.276673 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.277285 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.277376 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:17.277470 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:17.277559 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 02:23:17.277597 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":95,"threads_started":1}
I20260809 02:23:17.278854 584 tablet_service.cc:1467] Processing CreateTablet for tablet 280822a963684bff8ffb18a298ed2a88 (DEFAULT_TABLE table=test-table [id=1c976a455f8e46c7a4efc12f1c2734ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:17.278862 446 tablet_service.cc:1467] Processing CreateTablet for tablet 280822a963684bff8ffb18a298ed2a88 (DEFAULT_TABLE table=test-table [id=1c976a455f8e46c7a4efc12f1c2734ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:17.279044 305 tablet_service.cc:1467] Processing CreateTablet for tablet 280822a963684bff8ffb18a298ed2a88 (DEFAULT_TABLE table=test-table [id=1c976a455f8e46c7a4efc12f1c2734ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:23:17.279243 584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 280822a963684bff8ffb18a298ed2a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:17.279253 446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 280822a963684bff8ffb18a298ed2a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:17.279323 305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 280822a963684bff8ffb18a298ed2a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:17.281924 669 tablet_bootstrap.cc:492] T 280822a963684bff8ffb18a298ed2a88 P 8bcce975ea1b422dac8aa1a091ea7312: Bootstrap starting.
I20260809 02:23:17.282509 669 tablet_bootstrap.cc:654] T 280822a963684bff8ffb18a298ed2a88 P 8bcce975ea1b422dac8aa1a091ea7312: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:17.282509 670 tablet_bootstrap.cc:492] T 280822a963684bff8ffb18a298ed2a88 P 8d79e2da22a4434eb774c79f256f1f4b: Bootstrap starting.
I20260809 02:23:17.282831 669 log.cc:824] T 280822a963684bff8ffb18a298ed2a88 P 8bcce975ea1b422dac8aa1a091ea7312: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:17.283210 670 tablet_bootstrap.cc:654] T 280822a963684bff8ffb18a298ed2a88 P 8d79e2da22a4434eb774c79f256f1f4b: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:17.283505 670 log.cc:824] T 280822a963684bff8ffb18a298ed2a88 P 8d79e2da22a4434eb774c79f256f1f4b: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:17.283593 669 tablet_bootstrap.cc:492] T 280822a963684bff8ffb18a298ed2a88 P 8bcce975ea1b422dac8aa1a091ea7312: No bootstrap required, opened a new log
I20260809 02:23:17.283680 669 ts_tablet_manager.cc:1397] T 280822a963684bff8ffb18a298ed2a88 P 8bcce975ea1b422dac8aa1a091ea7312: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:23:17.283843 671 tablet_bootstrap.cc:492] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d: Bootstrap starting.
I20260809 02:23:17.284228 670 tablet_bootstrap.cc:492] T 280822a963684bff8ffb18a298ed2a88 P 8d79e2da22a4434eb774c79f256f1f4b: No bootstrap required, opened a new log
I20260809 02:23:17.284315 670 ts_tablet_manager.cc:1397] T 280822a963684bff8ffb18a298ed2a88 P 8d79e2da22a4434eb774c79f256f1f4b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:23:17.284439 671 tablet_bootstrap.cc:654] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:17.284713 671 log.cc:824] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:17.285403 671 tablet_bootstrap.cc:492] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d: No bootstrap required, opened a new log
I20260809 02:23:17.285494 671 ts_tablet_manager.cc:1397] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:23:17.286501 669 raft_consensus.cc:348] T 280822a963684bff8ffb18a298ed2a88 P 8bcce975ea1b422dac8aa1a091ea7312 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcce975ea1b422dac8aa1a091ea7312" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 38031 } } peers { permanent_uuid: "6c6bf22125b6454da3548f6c2e35f85d" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40127 } } peers { permanent_uuid: "8d79e2da22a4434eb774c79f256f1f4b" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46005 } }
I20260809 02:23:17.286679 669 raft_consensus.cc:374] T 280822a963684bff8ffb18a298ed2a88 P 8bcce975ea1b422dac8aa1a091ea7312 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:17.286715 669 raft_consensus.cc:729] T 280822a963684bff8ffb18a298ed2a88 P 8bcce975ea1b422dac8aa1a091ea7312 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bcce975ea1b422dac8aa1a091ea7312, State: Initialized, Role: FOLLOWER
I20260809 02:23:17.286859 669 consensus_queue.cc:260] T 280822a963684bff8ffb18a298ed2a88 P 8bcce975ea1b422dac8aa1a091ea7312 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcce975ea1b422dac8aa1a091ea7312" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 38031 } } peers { permanent_uuid: "6c6bf22125b6454da3548f6c2e35f85d" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40127 } } peers { permanent_uuid: "8d79e2da22a4434eb774c79f256f1f4b" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46005 } }
I20260809 02:23:17.286842 670 raft_consensus.cc:348] T 280822a963684bff8ffb18a298ed2a88 P 8d79e2da22a4434eb774c79f256f1f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcce975ea1b422dac8aa1a091ea7312" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 38031 } } peers { permanent_uuid: "6c6bf22125b6454da3548f6c2e35f85d" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40127 } } peers { permanent_uuid: "8d79e2da22a4434eb774c79f256f1f4b" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46005 } }
I20260809 02:23:17.287000 670 raft_consensus.cc:374] T 280822a963684bff8ffb18a298ed2a88 P 8d79e2da22a4434eb774c79f256f1f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:17.287052 670 raft_consensus.cc:729] T 280822a963684bff8ffb18a298ed2a88 P 8d79e2da22a4434eb774c79f256f1f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d79e2da22a4434eb774c79f256f1f4b, State: Initialized, Role: FOLLOWER
I20260809 02:23:17.287149 669 ts_tablet_manager.cc:1428] T 280822a963684bff8ffb18a298ed2a88 P 8bcce975ea1b422dac8aa1a091ea7312: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 02:23:17.287161 670 consensus_queue.cc:260] T 280822a963684bff8ffb18a298ed2a88 P 8d79e2da22a4434eb774c79f256f1f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcce975ea1b422dac8aa1a091ea7312" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 38031 } } peers { permanent_uuid: "6c6bf22125b6454da3548f6c2e35f85d" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40127 } } peers { permanent_uuid: "8d79e2da22a4434eb774c79f256f1f4b" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46005 } }
I20260809 02:23:17.287287 654 heartbeater.cc:503] Master 127.11.93.190:41841 was elected leader, sending a full tablet report...
I20260809 02:23:17.287412 670 ts_tablet_manager.cc:1428] T 280822a963684bff8ffb18a298ed2a88 P 8d79e2da22a4434eb774c79f256f1f4b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 02:23:17.287534 376 heartbeater.cc:503] Master 127.11.93.190:41841 was elected leader, sending a full tablet report...
I20260809 02:23:17.287915 671 raft_consensus.cc:348] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcce975ea1b422dac8aa1a091ea7312" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 38031 } } peers { permanent_uuid: "6c6bf22125b6454da3548f6c2e35f85d" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40127 } } peers { permanent_uuid: "8d79e2da22a4434eb774c79f256f1f4b" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46005 } }
I20260809 02:23:17.288067 671 raft_consensus.cc:374] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:17.288101 671 raft_consensus.cc:729] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c6bf22125b6454da3548f6c2e35f85d, State: Initialized, Role: FOLLOWER
I20260809 02:23:17.288223 671 consensus_queue.cc:260] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcce975ea1b422dac8aa1a091ea7312" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 38031 } } peers { permanent_uuid: "6c6bf22125b6454da3548f6c2e35f85d" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40127 } } peers { permanent_uuid: "8d79e2da22a4434eb774c79f256f1f4b" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46005 } }
I20260809 02:23:17.288477 671 ts_tablet_manager.cc:1428] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 02:23:17.288550 515 heartbeater.cc:503] Master 127.11.93.190:41841 was elected leader, sending a full tablet report...
I20260809 02:23:17.304595 678 raft_consensus.cc:482] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:23:17.304705 678 raft_consensus.cc:504] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcce975ea1b422dac8aa1a091ea7312" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 38031 } } peers { permanent_uuid: "6c6bf22125b6454da3548f6c2e35f85d" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40127 } } peers { permanent_uuid: "8d79e2da22a4434eb774c79f256f1f4b" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46005 } }
I20260809 02:23:17.305104 678 leader_election.cc:288] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bcce975ea1b422dac8aa1a091ea7312 (127.11.93.131:38031), 8d79e2da22a4434eb774c79f256f1f4b (127.11.93.129:46005)
I20260809 02:23:17.307842 667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.305359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:60765 (local address 127.11.93.129:46005)
0809 02:23:17.305416 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:17.305418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:17.305425 (+ 7us) server_negotiation.cc:407] Connection header received
0809 02:23:17.305451 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:17.305451 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:17.305460 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:17.305529 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:17.305685 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.306158 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.307132 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.307505 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.307588 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:17.307596 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:17.307736 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 02:23:17.307773 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 02:23:17.307843 517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.305255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:46005 (local address 127.11.93.130:60765)
0809 02:23:17.305310 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:17.305322 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:17.305362 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:17.305531 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:17.305532 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:17.305533 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:17.305608 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:17.305609 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.306237 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.306238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:17.307039 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:17.307044 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.307585 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.307586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:17.307661 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:17.307665 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:23:17.307730 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 02:23:17.307773 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 02:23:17.308089 679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.305265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.131:38031 (local address 127.11.93.130:38657)
0809 02:23:17.305487 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:17.305495 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:17.305572 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:17.305722 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:17.305723 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:17.305725 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:23:17.305802 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:17.305803 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.306429 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.306430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:17.307245 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:17.307248 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.307790 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.307791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:17.307860 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:17.307863 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:23:17.307930 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 02:23:17.307982 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":126,"threads_started":1}
I20260809 02:23:17.308192 666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.305345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.93.130:38657 (local address 127.11.93.131:38031)
0809 02:23:17.305425 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:17.305427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:17.305557 (+ 130us) server_negotiation.cc:407] Connection header received
0809 02:23:17.305643 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:17.305644 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:17.305653 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:17.305720 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:23:17.305879 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.306347 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.307337 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.307686 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.307777 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:17.307785 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:17.308066 (+ 281us) server_negotiation.cc:299] Negotiation successful
0809 02:23:17.308112 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 02:23:17.308210 325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "280822a963684bff8ffb18a298ed2a88" candidate_uuid: "6c6bf22125b6454da3548f6c2e35f85d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d79e2da22a4434eb774c79f256f1f4b" is_pre_election: true
I20260809 02:23:17.308362 325 raft_consensus.cc:2454] T 280822a963684bff8ffb18a298ed2a88 P 8d79e2da22a4434eb774c79f256f1f4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6bf22125b6454da3548f6c2e35f85d in term 0.
I20260809 02:23:17.308521 605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "280822a963684bff8ffb18a298ed2a88" candidate_uuid: "6c6bf22125b6454da3548f6c2e35f85d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bcce975ea1b422dac8aa1a091ea7312" is_pre_election: true
I20260809 02:23:17.308609 398 leader_election.cc:302] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6bf22125b6454da3548f6c2e35f85d, 8d79e2da22a4434eb774c79f256f1f4b; no voters:
I20260809 02:23:17.308657 605 raft_consensus.cc:2454] T 280822a963684bff8ffb18a298ed2a88 P 8bcce975ea1b422dac8aa1a091ea7312 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c6bf22125b6454da3548f6c2e35f85d in term 0.
I20260809 02:23:17.308744 678 raft_consensus.cc:2781] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:23:17.308828 678 raft_consensus.cc:482] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:23:17.308854 678 raft_consensus.cc:3037] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:17.309680 678 raft_consensus.cc:504] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcce975ea1b422dac8aa1a091ea7312" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 38031 } } peers { permanent_uuid: "6c6bf22125b6454da3548f6c2e35f85d" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40127 } } peers { permanent_uuid: "8d79e2da22a4434eb774c79f256f1f4b" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46005 } }
I20260809 02:23:17.309830 678 leader_election.cc:288] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d [CANDIDATE]: Term 1 election: Requested vote from peers 8bcce975ea1b422dac8aa1a091ea7312 (127.11.93.131:38031), 8d79e2da22a4434eb774c79f256f1f4b (127.11.93.129:46005)
I20260809 02:23:17.309947 605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "280822a963684bff8ffb18a298ed2a88" candidate_uuid: "6c6bf22125b6454da3548f6c2e35f85d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bcce975ea1b422dac8aa1a091ea7312"
I20260809 02:23:17.309964 325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "280822a963684bff8ffb18a298ed2a88" candidate_uuid: "6c6bf22125b6454da3548f6c2e35f85d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d79e2da22a4434eb774c79f256f1f4b"
I20260809 02:23:17.310019 605 raft_consensus.cc:3037] T 280822a963684bff8ffb18a298ed2a88 P 8bcce975ea1b422dac8aa1a091ea7312 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:17.310048 325 raft_consensus.cc:3037] T 280822a963684bff8ffb18a298ed2a88 P 8d79e2da22a4434eb774c79f256f1f4b [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:17.310645 605 raft_consensus.cc:2454] T 280822a963684bff8ffb18a298ed2a88 P 8bcce975ea1b422dac8aa1a091ea7312 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6bf22125b6454da3548f6c2e35f85d in term 1.
I20260809 02:23:17.310822 396 leader_election.cc:302] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c6bf22125b6454da3548f6c2e35f85d, 8bcce975ea1b422dac8aa1a091ea7312; no voters:
I20260809 02:23:17.310916 678 raft_consensus.cc:2781] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:17.310941 325 raft_consensus.cc:2454] T 280822a963684bff8ffb18a298ed2a88 P 8d79e2da22a4434eb774c79f256f1f4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c6bf22125b6454da3548f6c2e35f85d in term 1.
I20260809 02:23:17.311098 678 raft_consensus.cc:686] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d [term 1 LEADER]: Becoming Leader. State: Replica: 6c6bf22125b6454da3548f6c2e35f85d, State: Running, Role: LEADER
I20260809 02:23:17.311195 678 consensus_queue.cc:237] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcce975ea1b422dac8aa1a091ea7312" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 38031 } } peers { permanent_uuid: "6c6bf22125b6454da3548f6c2e35f85d" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40127 } } peers { permanent_uuid: "8d79e2da22a4434eb774c79f256f1f4b" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46005 } }
I20260809 02:23:17.312031 32634 catalog_manager.cc:5495] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c6bf22125b6454da3548f6c2e35f85d (127.11.93.130). New cstate: current_term: 1 leader_uuid: "6c6bf22125b6454da3548f6c2e35f85d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bcce975ea1b422dac8aa1a091ea7312" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 38031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c6bf22125b6454da3548f6c2e35f85d" member_type: VOTER last_known_addr { host: "127.11.93.130" port: 40127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d79e2da22a4434eb774c79f256f1f4b" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46005 } health_report { overall_health: UNKNOWN } } }
I20260809 02:23:17.322885 668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.320792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46302 (local address 127.11.93.130:40127)
0809 02:23:17.320881 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:17.320883 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:17.320890 (+ 7us) server_negotiation.cc:407] Connection header received
0809 02:23:17.320920 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:17.320921 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:17.320936 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:17.320999 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:17.321105 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.321555 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.322243 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:17.322442 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:17.322492 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:17.322615 (+ 123us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:17.322708 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:17.322765 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:17.322796 (+ 31us) server_negotiation.cc:299] Negotiation successful
0809 02:23:17.322812 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 02:23:17.324726 325 raft_consensus.cc:1261] T 280822a963684bff8ffb18a298ed2a88 P 8d79e2da22a4434eb774c79f256f1f4b [term 1 FOLLOWER]: Refusing update from remote peer 6c6bf22125b6454da3548f6c2e35f85d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:17.324771 605 raft_consensus.cc:1261] T 280822a963684bff8ffb18a298ed2a88 P 8bcce975ea1b422dac8aa1a091ea7312 [term 1 FOLLOWER]: Refusing update from remote peer 6c6bf22125b6454da3548f6c2e35f85d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:17.325081 680 consensus_queue.cc:1035] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bcce975ea1b422dac8aa1a091ea7312" member_type: VOTER last_known_addr { host: "127.11.93.131" port: 38031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:17.325201 678 consensus_queue.cc:1035] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d79e2da22a4434eb774c79f256f1f4b" member_type: VOTER last_known_addr { host: "127.11.93.129" port: 46005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:17.328050 684 mvcc.cc:205] Tried to move back new op lower bound from 7316448040239300608 to 7316448040187469824. Current Snapshot: MvccSnapshot[applied={T|T < 7316448040239300608}]
I20260809 02:23:17.328680 685 mvcc.cc:205] Tried to move back new op lower bound from 7316448040239300608 to 7316448040187469824. Current Snapshot: MvccSnapshot[applied={T|T < 7316448040239300608}]
I20260809 02:23:17.328886 683 mvcc.cc:205] Tried to move back new op lower bound from 7316448040239300608 to 7316448040187469824. Current Snapshot: MvccSnapshot[applied={T|T < 7316448040239300608 or (T in {7316448040239300608})}]
I20260809 02:23:17.330789 32634 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:23:17.330873 32634 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:23:17.331627 32634 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 72438e128d7743a5b358c510ce70ffb9: Sending DeleteTablet for 3 replicas of tablet 280822a963684bff8ffb18a298ed2a88
I20260809 02:23:17.332008 446 tablet_service.cc:1514] Processing DeleteTablet for tablet 280822a963684bff8ffb18a298ed2a88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:17 UTC) from {username='slave'} at 127.0.0.1:46290
I20260809 02:23:17.332068 584 tablet_service.cc:1514] Processing DeleteTablet for tablet 280822a963684bff8ffb18a298ed2a88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:17 UTC) from {username='slave'} at 127.0.0.1:35322
I20260809 02:23:17.332293 305 tablet_service.cc:1514] Processing DeleteTablet for tablet 280822a963684bff8ffb18a298ed2a88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:23:17 UTC) from {username='slave'} at 127.0.0.1:47922
I20260809 02:23:17.332420 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 32707
I20260809 02:23:17.332505 694 tablet_replica.cc:330] T 280822a963684bff8ffb18a298ed2a88 P 8d79e2da22a4434eb774c79f256f1f4b: stopping tablet replica
I20260809 02:23:17.332607 694 raft_consensus.cc:2229] T 280822a963684bff8ffb18a298ed2a88 P 8d79e2da22a4434eb774c79f256f1f4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:23:17.332696 694 raft_consensus.cc:2258] T 280822a963684bff8ffb18a298ed2a88 P 8d79e2da22a4434eb774c79f256f1f4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:23:17.337813 693 tablet_replica.cc:330] T 280822a963684bff8ffb18a298ed2a88 P 8bcce975ea1b422dac8aa1a091ea7312: stopping tablet replica
I20260809 02:23:17.337980 693 raft_consensus.cc:2229] T 280822a963684bff8ffb18a298ed2a88 P 8bcce975ea1b422dac8aa1a091ea7312 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:23:17.338120 693 raft_consensus.cc:2258] T 280822a963684bff8ffb18a298ed2a88 P 8bcce975ea1b422dac8aa1a091ea7312 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:23:17.338361 692 tablet_replica.cc:330] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d: stopping tablet replica
I20260809 02:23:17.338465 692 raft_consensus.cc:2229] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:23:17.338595 692 raft_consensus.cc:2258] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:23:17.339233 693 ts_tablet_manager.cc:1905] T 280822a963684bff8ffb18a298ed2a88 P 8bcce975ea1b422dac8aa1a091ea7312: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:23:17.339234 692 ts_tablet_manager.cc:1905] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 02:23:17.340565 32621 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.93.129:46005 (error 108)
I20260809 02:23:17.341097 692 ts_tablet_manager.cc:1918] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:23:17.341250 692 log.cc:1196] T 280822a963684bff8ffb18a298ed2a88 P 6c6bf22125b6454da3548f6c2e35f85d: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-1/wal/wals/280822a963684bff8ffb18a298ed2a88
I20260809 02:23:17.341251 693 ts_tablet_manager.cc:1918] T 280822a963684bff8ffb18a298ed2a88 P 8bcce975ea1b422dac8aa1a091ea7312: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:23:17.341334 693 log.cc:1196] T 280822a963684bff8ffb18a298ed2a88 P 8bcce975ea1b422dac8aa1a091ea7312: Deleting WAL directory at /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786241951749734-11638-0/minicluster-data/ts-2/wal/wals/280822a963684bff8ffb18a298ed2a88
I20260809 02:23:17.341387 665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.341248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.129:46005 (local address 127.0.0.1:47936)
0809 02:23:17.341303 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:17.341349 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.129:46005: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 02:23:17.341507 32621 catalog_manager.cc:4584] TS 8d79e2da22a4434eb774c79f256f1f4b (127.11.93.129:46005): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 280822a963684bff8ffb18a298ed2a88: Network error: Client connection negotiation failed: client connection to 127.11.93.129:46005: connect: Connection refused (error 111)
I20260809 02:23:17.341619 693 ts_tablet_manager.cc:1939] T 280822a963684bff8ffb18a298ed2a88 P 8bcce975ea1b422dac8aa1a091ea7312: Deleting consensus metadata
I20260809 02:23:17.341701 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 379
I20260809 02:23:17.342895 32619 catalog_manager.cc:4841] TS 8bcce975ea1b422dac8aa1a091ea7312 (127.11.93.131:38031): tablet 280822a963684bff8ffb18a298ed2a88 (table test-table [id=1c976a455f8e46c7a4efc12f1c2734ae]) successfully deleted
I20260809 02:23:17.349201 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 518
I20260809 02:23:17.349242 665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:17.349118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.130:40127 (local address 127.0.0.1:46314)
0809 02:23:17.349177 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:17.349212 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.130:40127: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 02:23:17.354619 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 32602
2026-08-09T02:23:17Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (680 ms)
[----------] 6 tests from EncryptionPolicyTest (8375 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:17 dist-test-slave-w206 krb5kdc[698](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:17 dist-test-slave-w206 krb5kdc[698](info): set up 2 sockets
Aug 09 02:23:17 dist-test-slave-w206 krb5kdc[698](info): commencing operation
krb5kdc: starting...
W20260809 02:23:18.439047 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:23:18 dist-test-slave-w206 krb5kdc[698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242198, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:23:18.566075 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38005
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38005
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:18.648864 711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:18.649081 711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:18.649106 711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:18.650310 711 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:18.650355 711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:18.650370 711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:18.650383 711 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:18.650395 711 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:18.651983 711 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38005
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.711
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:18.652246 711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:18.652505 711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:18.657994 719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:18.657923 717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:18.657949 711 server_base.cc:1034] running on GCE node
W20260809 02:23:18.657923 716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:18.658537 711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:18.658838 711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:18.659987 711 hybrid_clock.cc:648] HybridClock initialized: now 1786242198659967 us; error 54 us; skew 500 ppm
Aug 09 02:23:18 dist-test-slave-w206 krb5kdc[698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242198, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:18.662688 711 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:23:18.663175 711 webserver.cc:460] Webserver started at http://127.0.0.1:43679/ using document root <none> and password file <none>
I20260809 02:23:18.663439 711 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:18.663488 711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:18.663635 711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:18.664727 711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "ae462d78269b4a77a2b17113df1329d7"
format_stamp: "Formatted at 2026-08-09 02:23:18 on dist-test-slave-w206"
server_key: "089a8682694f9b39cd5cb9f450a3b7e1"
server_key_iv: "6f6a8808033261f0fee689a9b013a9ef"
server_key_version: "encryptionkey@0"
I20260809 02:23:18.665102 711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "ae462d78269b4a77a2b17113df1329d7"
format_stamp: "Formatted at 2026-08-09 02:23:18 on dist-test-slave-w206"
server_key: "089a8682694f9b39cd5cb9f450a3b7e1"
server_key_iv: "6f6a8808033261f0fee689a9b013a9ef"
server_key_version: "encryptionkey@0"
I20260809 02:23:18.666527 711 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:23:18.667546 729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:18.667763 711 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 02:23:18.667869 711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "ae462d78269b4a77a2b17113df1329d7"
format_stamp: "Formatted at 2026-08-09 02:23:18 on dist-test-slave-w206"
server_key: "089a8682694f9b39cd5cb9f450a3b7e1"
server_key_iv: "6f6a8808033261f0fee689a9b013a9ef"
server_key_version: "encryptionkey@0"
I20260809 02:23:18.667956 711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:18.685633 711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:18.688110 711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:18.688277 711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:18.692404 711 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38005
I20260809 02:23:18.692449 784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38005 every 8 connection(s)
I20260809 02:23:18.692819 711 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:18.693718 785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:18.696477 785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7: Bootstrap starting.
I20260809 02:23:18.697081 785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:18.697381 785 log.cc:824] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:18.698083 785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7: No bootstrap required, opened a new log
I20260809 02:23:18.699867 785 raft_consensus.cc:348] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae462d78269b4a77a2b17113df1329d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38005 } }
I20260809 02:23:18.700099 785 raft_consensus.cc:374] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:18.700161 785 raft_consensus.cc:729] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae462d78269b4a77a2b17113df1329d7, State: Initialized, Role: FOLLOWER
I20260809 02:23:18.700316 785 consensus_queue.cc:260] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae462d78269b4a77a2b17113df1329d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38005 } }
I20260809 02:23:18.700426 785 raft_consensus.cc:388] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:18.700467 785 raft_consensus.cc:482] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:18.700513 785 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:18.701047 785 raft_consensus.cc:504] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae462d78269b4a77a2b17113df1329d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38005 } }
I20260809 02:23:18.701171 785 leader_election.cc:302] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ae462d78269b4a77a2b17113df1329d7; no voters:
I20260809 02:23:18.701341 785 leader_election.cc:288] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:18.701393 788 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:18.701583 788 raft_consensus.cc:686] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7 [term 1 LEADER]: Becoming Leader. State: Replica: ae462d78269b4a77a2b17113df1329d7, State: Running, Role: LEADER
I20260809 02:23:18.701632 785 sys_catalog.cc:564] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:18.701880 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 711
I20260809 02:23:18.701978 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:18.702171 11638 external_mini_cluster.cc:1428] Setting key 22b0aca84365b113e77693de7a899dcb
I20260809 02:23:18.701694 788 consensus_queue.cc:237] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae462d78269b4a77a2b17113df1329d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38005 } }
I20260809 02:23:18.703080 789 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ae462d78269b4a77a2b17113df1329d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae462d78269b4a77a2b17113df1329d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38005 } } }
I20260809 02:23:18.703265 789 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:18.703476 790 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ae462d78269b4a77a2b17113df1329d7. Latest consensus state: current_term: 1 leader_uuid: "ae462d78269b4a77a2b17113df1329d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae462d78269b4a77a2b17113df1329d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38005 } } }
I20260809 02:23:18.703744 790 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7 [sys.catalog]: This master's current role is: LEADER
W20260809 02:23:18.704267 808 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:23:18.704327 808 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:23:18.704401 806 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:18.704576 806 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:18.706161 806 catalog_manager.cc:1347] Generated new cluster ID: 920f783e7fa546168e97743825740f1a
I20260809 02:23:18.706218 806 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 02:23:18 dist-test-slave-w206 krb5kdc[698](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242198, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 02:23:18.711037 806 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:18.711709 806 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:18.715245 799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.702965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51771 (local address 127.0.0.1:38005)
0809 02:23:18.703315 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:18.703324 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:18.703359 (+ 35us) server_negotiation.cc:407] Connection header received
0809 02:23:18.703480 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:18.703487 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:18.703562 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:18.704590 (+ 1028us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:18.704691 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.705941 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.707110 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.707705 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.708117 (+ 412us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.710922 (+ 2805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:18.710926 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:18.710926 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:18.710938 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:18.713167 (+ 2229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.713645 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.713648 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.713648 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.713763 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.713982 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.713983 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.713983 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.714242 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:18.714795 (+ 553us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:18.714877 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 02:23:18.715003 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":103,"threads_started":1}
I20260809 02:23:18.716061 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:23:18.716527 806 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ae462d78269b4a77a2b17113df1329d7: Generated new TSK 0
I20260809 02:23:18.716727 806 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:18.724398 799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:18.717723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40577 (local address 127.0.0.1:38005)
0809 02:23:18.717783 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:18.717786 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:18.717862 (+ 76us) server_negotiation.cc:407] Connection header received
0809 02:23:18.717935 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:18.717936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:18.717946 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:18.717989 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:18.718552 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.719178 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.719947 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:18.720186 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:18.720268 (+ 82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:18.721623 (+ 1355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:18.721624 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:18.721624 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:18.721631 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:18.723102 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.723574 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.723575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.723575 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.723635 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:18.723872 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:18.723873 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:18.723873 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:18.723987 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:18.724100 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:18.724228 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 02:23:18.724295 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 02:23:18.726822 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 711
W20260809 02:23:18.732991 696 connection.cc:535] client connection to 127.0.0.1:38005 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38005): Connection reset by peer (error 104)
2026-08-09T02:23:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1371 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:18 dist-test-slave-w206 krb5kdc[818](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:18 dist-test-slave-w206 krb5kdc[818](info): set up 2 sockets
Aug 09 02:23:18 dist-test-slave-w206 krb5kdc[818](info): commencing operation
krb5kdc: starting...
W20260809 02:23:19.908428 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:23:19 dist-test-slave-w206 krb5kdc[818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242199, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:23:20.038448 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45721
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45721
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:20.120802 833 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:20.121048 833 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:20.121085 833 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:20.122259 833 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:20.122332 833 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:20.122356 833 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:20.122385 833 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:20.122416 833 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:20.124014 833 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45721
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.833
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:20.124300 833 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:20.124539 833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:20.130137 838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:20.130131 839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:20.130141 841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:20.130268 833 server_base.cc:1034] running on GCE node
I20260809 02:23:20.130549 833 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:20.130897 833 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:20.132098 833 hybrid_clock.cc:648] HybridClock initialized: now 1786242200132091 us; error 55 us; skew 500 ppm
Aug 09 02:23:20 dist-test-slave-w206 krb5kdc[818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242200, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:20.139550 833 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:23:20.140092 833 webserver.cc:460] Webserver started at http://127.0.0.1:40651/ using document root <none> and password file <none>
I20260809 02:23:20.140372 833 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:20.140451 833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:20.140618 833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:20.141779 833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "523e9e1bd4a449fd87a1a9f2289638ac"
format_stamp: "Formatted at 2026-08-09 02:23:20 on dist-test-slave-w206"
server_key: "6433b3ce969be09308307054b9ae2854"
server_key_iv: "792e551f5f8ce1048496b5f5c7912069"
server_key_version: "encryptionkey@0"
I20260809 02:23:20.142236 833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "523e9e1bd4a449fd87a1a9f2289638ac"
format_stamp: "Formatted at 2026-08-09 02:23:20 on dist-test-slave-w206"
server_key: "6433b3ce969be09308307054b9ae2854"
server_key_iv: "792e551f5f8ce1048496b5f5c7912069"
server_key_version: "encryptionkey@0"
I20260809 02:23:20.143863 833 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:23:20.144922 848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:20.145241 833 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:20.145401 833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "523e9e1bd4a449fd87a1a9f2289638ac"
format_stamp: "Formatted at 2026-08-09 02:23:20 on dist-test-slave-w206"
server_key: "6433b3ce969be09308307054b9ae2854"
server_key_iv: "792e551f5f8ce1048496b5f5c7912069"
server_key_version: "encryptionkey@0"
I20260809 02:23:20.145491 833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:20.153369 833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:20.155817 833 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:20.155987 833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:20.160401 833 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45721
I20260809 02:23:20.160454 901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45721 every 8 connection(s)
I20260809 02:23:20.160869 833 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:20.161849 902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:20.163935 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 833
I20260809 02:23:20.164100 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:20.164326 11638 external_mini_cluster.cc:1428] Setting key 4e1999e4bcb1cab9221a5a7e9384027e
I20260809 02:23:20.164634 902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac: Bootstrap starting.
I20260809 02:23:20.165340 902 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:20.165657 902 log.cc:824] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:20.166492 902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac: No bootstrap required, opened a new log
I20260809 02:23:20.168633 902 raft_consensus.cc:348] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "523e9e1bd4a449fd87a1a9f2289638ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45721 } }
I20260809 02:23:20.168785 902 raft_consensus.cc:374] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:20.168807 902 raft_consensus.cc:729] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523e9e1bd4a449fd87a1a9f2289638ac, State: Initialized, Role: FOLLOWER
I20260809 02:23:20.168992 902 consensus_queue.cc:260] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "523e9e1bd4a449fd87a1a9f2289638ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45721 } }
I20260809 02:23:20.169073 902 raft_consensus.cc:388] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:20.169118 902 raft_consensus.cc:482] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:20.169170 902 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:20.169786 902 raft_consensus.cc:504] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "523e9e1bd4a449fd87a1a9f2289638ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45721 } }
I20260809 02:23:20.169930 902 leader_election.cc:302] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 523e9e1bd4a449fd87a1a9f2289638ac; no voters:
I20260809 02:23:20.170110 902 leader_election.cc:288] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:20.170244 908 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:20.170408 902 sys_catalog.cc:564] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:20.170480 908 raft_consensus.cc:686] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac [term 1 LEADER]: Becoming Leader. State: Replica: 523e9e1bd4a449fd87a1a9f2289638ac, State: Running, Role: LEADER
I20260809 02:23:20.170635 908 consensus_queue.cc:237] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "523e9e1bd4a449fd87a1a9f2289638ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45721 } }
I20260809 02:23:20.171249 909 sys_catalog.cc:455] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "523e9e1bd4a449fd87a1a9f2289638ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "523e9e1bd4a449fd87a1a9f2289638ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45721 } } }
I20260809 02:23:20.171241 910 sys_catalog.cc:455] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 523e9e1bd4a449fd87a1a9f2289638ac. Latest consensus state: current_term: 1 leader_uuid: "523e9e1bd4a449fd87a1a9f2289638ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "523e9e1bd4a449fd87a1a9f2289638ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45721 } } }
I20260809 02:23:20.171320 906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:20.164872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51087 (local address 127.0.0.1:45721)
0809 02:23:20.165078 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:20.165090 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:20.165131 (+ 41us) server_negotiation.cc:407] Connection header received
0809 02:23:20.165677 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:20.165685 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:20.165783 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:20.165956 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:20.166152 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:20.167775 (+ 1623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:20.168742 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:20.169414 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:20.169563 (+ 149us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:20.170418 (+ 855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:20.170423 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:20.170423 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:20.170662 (+ 239us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:20.170714 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:20.170729 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:20.170790 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:20.171035 (+ 245us) server_negotiation.cc:299] Negotiation successful
0809 02:23:20.171072 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":94,"threads_started":1}
I20260809 02:23:20.171361 909 sys_catalog.cc:458] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:20.171365 910 sys_catalog.cc:458] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac [sys.catalog]: This master's current role is: LEADER
W20260809 02:23:20.172817 925 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:23:20.172885 925 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:23:20.172947 915 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:20.172940 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:23:20.173166 915 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:20.174865 915 catalog_manager.cc:1347] Generated new cluster ID: a89e833491a344a9aa6ff322dc832a0a
I20260809 02:23:20.174926 915 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:20.182708 906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:20.174415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49051 (local address 127.0.0.1:45721)
0809 02:23:20.174452 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:20.174454 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:20.179342 (+ 4888us) server_negotiation.cc:407] Connection header received
0809 02:23:20.179427 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:20.179428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:20.179438 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:20.179522 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:20.179684 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:20.180511 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:20.181335 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:20.181566 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:20.181645 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:20.182419 (+ 774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:20.182420 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:20.182420 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:20.182425 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:20.182449 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:20.182453 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:20.182522 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:20.182590 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 02:23:20.182600 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 02:23:20.193756 915 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:20.194605 915 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:20.200219 915 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 523e9e1bd4a449fd87a1a9f2289638ac: Generated new TSK 0
I20260809 02:23:20.200426 915 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:20.205508 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 833
W20260809 02:23:20.212673 816 connection.cc:535] client connection to 127.0.0.1:45721 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45721): Connection reset by peer (error 104)
2026-08-09T02:23:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1480 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:20 dist-test-slave-w206 krb5kdc[936](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:20 dist-test-slave-w206 krb5kdc[936](info): set up 2 sockets
Aug 09 02:23:20 dist-test-slave-w206 krb5kdc[936](info): commencing operation
krb5kdc: starting...
W20260809 02:23:21.316506 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.090s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:23:21 dist-test-slave-w206 krb5kdc[936](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:23:21.449687 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46353
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46353
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:21.534591 950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:21.534858 950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:21.534901 950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:21.536140 950 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:21.536231 950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:21.536265 950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:21.536298 950 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:21.536329 950 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:21.537911 950 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46353
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:21.538200 950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:21.538445 950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:21.543534 955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:21.543545 956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:21.543557 958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:21.543977 950 server_base.cc:1034] running on GCE node
I20260809 02:23:21.544205 950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:21.544505 950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:21.545698 950 hybrid_clock.cc:648] HybridClock initialized: now 1786242201545674 us; error 42 us; skew 500 ppm
Aug 09 02:23:21 dist-test-slave-w206 krb5kdc[936](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242201, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:21.548626 950 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:23:21.549048 950 webserver.cc:460] Webserver started at http://127.0.0.1:33189/ using document root <none> and password file <none>
I20260809 02:23:21.549316 950 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:21.549371 950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:21.549465 950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:21.550597 950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "662b7dc2926c490ca784cdd6c85461f7"
format_stamp: "Formatted at 2026-08-09 02:23:21 on dist-test-slave-w206"
server_key: "af7a2b01e1e09e321fc301a79b93b3d3"
server_key_iv: "055875e3cc4f04cb627deb03bc115623"
server_key_version: "encryptionkey@0"
I20260809 02:23:21.550938 950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "662b7dc2926c490ca784cdd6c85461f7"
format_stamp: "Formatted at 2026-08-09 02:23:21 on dist-test-slave-w206"
server_key: "af7a2b01e1e09e321fc301a79b93b3d3"
server_key_iv: "055875e3cc4f04cb627deb03bc115623"
server_key_version: "encryptionkey@0"
I20260809 02:23:21.552404 950 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:23:21.553149 966 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:21.553349 950 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:23:21.553436 950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "662b7dc2926c490ca784cdd6c85461f7"
format_stamp: "Formatted at 2026-08-09 02:23:21 on dist-test-slave-w206"
server_key: "af7a2b01e1e09e321fc301a79b93b3d3"
server_key_iv: "055875e3cc4f04cb627deb03bc115623"
server_key_version: "encryptionkey@0"
I20260809 02:23:21.553493 950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:21.556882 950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:21.558964 950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:21.559144 950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:21.563061 950 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46353
I20260809 02:23:21.563122 1019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46353 every 8 connection(s)
I20260809 02:23:21.563477 950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:21.564477 1020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:21.565136 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 950
I20260809 02:23:21.565231 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:21.565439 11638 external_mini_cluster.cc:1428] Setting key 8550012bcbcab41835e92b8db1b999f9
I20260809 02:23:21.568022 1020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7: Bootstrap starting.
I20260809 02:23:21.568285 1023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:21.566001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58149 (local address 127.0.0.1:46353)
0809 02:23:21.566295 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:21.566306 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:21.566342 (+ 36us) server_negotiation.cc:407] Connection header received
0809 02:23:21.566938 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:21.566947 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:21.567009 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:21.567175 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:21.567837 (+ 662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:21.567841 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:21.567841 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:21.567846 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:21.567892 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:21.567907 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:21.567989 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:21.568044 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 02:23:21.568087 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":62,"threads_started":1}
I20260809 02:23:21.568852 1020 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:21.569252 1020 log.cc:824] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:21.569352 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:23:21.569985 1020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7: No bootstrap required, opened a new log
I20260809 02:23:21.571844 1023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:21.570775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40545 (local address 127.0.0.1:46353)
0809 02:23:21.570824 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:21.570825 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:21.570919 (+ 94us) server_negotiation.cc:407] Connection header received
0809 02:23:21.571023 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:21.571024 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:21.571029 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:21.571097 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:21.571659 (+ 562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:21.571660 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:21.571660 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:21.571663 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:21.571676 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:21.571679 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:21.571722 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:21.571792 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 02:23:21.571803 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 02:23:21.572985 1020 raft_consensus.cc:348] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "662b7dc2926c490ca784cdd6c85461f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46353 } }
I20260809 02:23:21.573130 1020 raft_consensus.cc:374] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:21.573155 1020 raft_consensus.cc:729] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 662b7dc2926c490ca784cdd6c85461f7, State: Initialized, Role: FOLLOWER
I20260809 02:23:21.573256 1020 consensus_queue.cc:260] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "662b7dc2926c490ca784cdd6c85461f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46353 } }
I20260809 02:23:21.573326 1020 raft_consensus.cc:388] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:21.573349 1020 raft_consensus.cc:482] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:21.573385 1020 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:21.573942 1020 raft_consensus.cc:504] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "662b7dc2926c490ca784cdd6c85461f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46353 } }
I20260809 02:23:21.574034 1020 leader_election.cc:302] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 662b7dc2926c490ca784cdd6c85461f7; no voters:
I20260809 02:23:21.574174 1020 leader_election.cc:288] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:21.574262 1030 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:21.574441 1030 raft_consensus.cc:686] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7 [term 1 LEADER]: Becoming Leader. State: Replica: 662b7dc2926c490ca784cdd6c85461f7, State: Running, Role: LEADER
I20260809 02:23:21.574460 1020 sys_catalog.cc:564] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:21.574534 1030 consensus_queue.cc:237] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "662b7dc2926c490ca784cdd6c85461f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46353 } }
I20260809 02:23:21.574937 1032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 662b7dc2926c490ca784cdd6c85461f7. Latest consensus state: current_term: 1 leader_uuid: "662b7dc2926c490ca784cdd6c85461f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "662b7dc2926c490ca784cdd6c85461f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46353 } } }
I20260809 02:23:21.575078 1032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:21.574928 1031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "662b7dc2926c490ca784cdd6c85461f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "662b7dc2926c490ca784cdd6c85461f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46353 } } }
I20260809 02:23:21.575222 1031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7 [sys.catalog]: This master's current role is: LEADER
W20260809 02:23:21.576354 1047 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:23:21.576443 1047 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:23:21.576493 1038 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:21.576649 1038 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:21.578281 1038 catalog_manager.cc:1347] Generated new cluster ID: 36402a9a10f444639c3df56b3cec880c
I20260809 02:23:21.578348 1038 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:21.587687 1038 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:21.587963 1038 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:21.592820 1038 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 662b7dc2926c490ca784cdd6c85461f7: Generated new TSK 0
I20260809 02:23:21.593071 1038 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:21.598734 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 950
2026-08-09T02:23:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1391 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:21 dist-test-slave-w206 krb5kdc[1052](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:21 dist-test-slave-w206 krb5kdc[1052](info): set up 2 sockets
Aug 09 02:23:21 dist-test-slave-w206 krb5kdc[1052](info): commencing operation
krb5kdc: starting...
W20260809 02:23:22.689349 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:23:22 dist-test-slave-w206 krb5kdc[1052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242202, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:23:22.820164 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43431
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43431
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:22.905010 1066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:22.905314 1066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:22.905360 1066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:22.906637 1066 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:22.906733 1066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:22.906764 1066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:22.906800 1066 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:22.906828 1066 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:22.908562 1066 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43431
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1066
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:22.908888 1066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:22.909157 1066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:22.914273 1075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:22.914500 1071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:22.914386 1072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:22.914475 1066 server_base.cc:1034] running on GCE node
I20260809 02:23:22.914808 1066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:22.915170 1066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:22.916355 1066 hybrid_clock.cc:648] HybridClock initialized: now 1786242202916342 us; error 48 us; skew 500 ppm
Aug 09 02:23:22 dist-test-slave-w206 krb5kdc[1052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242202, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:22.919132 1066 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:23:22.919590 1066 webserver.cc:460] Webserver started at http://127.0.0.1:35613/ using document root <none> and password file <none>
I20260809 02:23:22.919802 1066 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:22.919852 1066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:22.919960 1066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:22.920991 1066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "72afd80bad4b4b5abe91cadf195779b7"
format_stamp: "Formatted at 2026-08-09 02:23:22 on dist-test-slave-w206"
server_key: "5e24c26d6ad1a8f7a184c5f8562ff5c2"
server_key_iv: "4e5c19dc83a8a34058f1c0f8a552379c"
server_key_version: "encryptionkey@0"
I20260809 02:23:22.921285 1066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "72afd80bad4b4b5abe91cadf195779b7"
format_stamp: "Formatted at 2026-08-09 02:23:22 on dist-test-slave-w206"
server_key: "5e24c26d6ad1a8f7a184c5f8562ff5c2"
server_key_iv: "4e5c19dc83a8a34058f1c0f8a552379c"
server_key_version: "encryptionkey@0"
I20260809 02:23:22.922672 1066 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:23:22.923607 1082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:22.923771 1066 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 02:23:22.923864 1066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "72afd80bad4b4b5abe91cadf195779b7"
format_stamp: "Formatted at 2026-08-09 02:23:22 on dist-test-slave-w206"
server_key: "5e24c26d6ad1a8f7a184c5f8562ff5c2"
server_key_iv: "4e5c19dc83a8a34058f1c0f8a552379c"
server_key_version: "encryptionkey@0"
I20260809 02:23:22.923923 1066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:22.939443 1066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:22.941800 1066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:22.941919 1066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:22.946110 1066 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43431
I20260809 02:23:22.946141 1139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43431 every 8 connection(s)
I20260809 02:23:22.946542 1066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:22.947577 1140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:22.950141 1140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72afd80bad4b4b5abe91cadf195779b7: Bootstrap starting.
I20260809 02:23:22.950769 1140 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72afd80bad4b4b5abe91cadf195779b7: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:22.951122 1140 log.cc:824] T 00000000000000000000000000000000 P 72afd80bad4b4b5abe91cadf195779b7: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:22.951913 1140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72afd80bad4b4b5abe91cadf195779b7: No bootstrap required, opened a new log
I20260809 02:23:22.953547 1140 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72afd80bad4b4b5abe91cadf195779b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72afd80bad4b4b5abe91cadf195779b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43431 } }
I20260809 02:23:22.953696 1140 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72afd80bad4b4b5abe91cadf195779b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:22.953760 1140 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72afd80bad4b4b5abe91cadf195779b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72afd80bad4b4b5abe91cadf195779b7, State: Initialized, Role: FOLLOWER
I20260809 02:23:22.953938 1140 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72afd80bad4b4b5abe91cadf195779b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72afd80bad4b4b5abe91cadf195779b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43431 } }
I20260809 02:23:22.954025 1140 raft_consensus.cc:388] T 00000000000000000000000000000000 P 72afd80bad4b4b5abe91cadf195779b7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:22.954047 1140 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72afd80bad4b4b5abe91cadf195779b7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:22.954145 1140 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72afd80bad4b4b5abe91cadf195779b7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:22.954696 1140 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72afd80bad4b4b5abe91cadf195779b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72afd80bad4b4b5abe91cadf195779b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43431 } }
I20260809 02:23:22.954825 1140 leader_election.cc:302] T 00000000000000000000000000000000 P 72afd80bad4b4b5abe91cadf195779b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72afd80bad4b4b5abe91cadf195779b7; no voters:
I20260809 02:23:22.955049 1140 leader_election.cc:288] T 00000000000000000000000000000000 P 72afd80bad4b4b5abe91cadf195779b7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:22.955103 1143 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72afd80bad4b4b5abe91cadf195779b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:22.955317 1140 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72afd80bad4b4b5abe91cadf195779b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:22.955379 1143 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72afd80bad4b4b5abe91cadf195779b7 [term 1 LEADER]: Becoming Leader. State: Replica: 72afd80bad4b4b5abe91cadf195779b7, State: Running, Role: LEADER
I20260809 02:23:22.955513 1143 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72afd80bad4b4b5abe91cadf195779b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72afd80bad4b4b5abe91cadf195779b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43431 } }
I20260809 02:23:22.955919 1144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72afd80bad4b4b5abe91cadf195779b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72afd80bad4b4b5abe91cadf195779b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72afd80bad4b4b5abe91cadf195779b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43431 } } }
I20260809 02:23:22.956001 1144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72afd80bad4b4b5abe91cadf195779b7 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:22.956068 1145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72afd80bad4b4b5abe91cadf195779b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72afd80bad4b4b5abe91cadf195779b7. Latest consensus state: current_term: 1 leader_uuid: "72afd80bad4b4b5abe91cadf195779b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72afd80bad4b4b5abe91cadf195779b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43431 } } }
I20260809 02:23:22.956151 1145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72afd80bad4b4b5abe91cadf195779b7 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:22.956176 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 1066
I20260809 02:23:22.956302 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:22.956509 11638 external_mini_cluster.cc:1428] Setting key 740ee84740fb82dd8baeefd27c05dfe8
I20260809 02:23:22.956743 1151 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:22.957526 1151 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:22.959618 1151 catalog_manager.cc:1347] Generated new cluster ID: 2b1f36d25ee640edadc1a73e82389000
I20260809 02:23:22.959684 1151 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 02:23:22 dist-test-slave-w206 krb5kdc[1052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242202, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 02:23:22.968309 1155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:22.956990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35067 (local address 127.0.0.1:43431)
0809 02:23:22.957240 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:22.957257 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:22.957344 (+ 87us) server_negotiation.cc:407] Connection header received
0809 02:23:22.957542 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:22.957551 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:22.957628 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:22.958731 (+ 1103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:22.958831 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:22.960144 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:22.960982 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:22.961442 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:22.961607 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:22.964173 (+ 2566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:22.964183 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:22.964183 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:22.964196 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:22.966537 (+ 2341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:22.966956 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:22.966959 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:22.966959 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:22.967128 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:22.967372 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:22.967373 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:22.967373 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:22.967639 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:22.967836 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:22.967912 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 02:23:22.968067 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":93,"threads_started":1}
I20260809 02:23:22.969218 1151 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:22.969444 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:23:22.969888 1151 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:22.974494 1151 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 72afd80bad4b4b5abe91cadf195779b7: Generated new TSK 0
I20260809 02:23:22.974700 1151 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:22.978276 1155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:22.971068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43397 (local address 127.0.0.1:43431)
0809 02:23:22.971105 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:22.971106 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:22.971168 (+ 62us) server_negotiation.cc:407] Connection header received
0809 02:23:22.971246 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:22.971247 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:22.971257 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:22.971324 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:22.971900 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:22.972709 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:22.973751 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:22.974242 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:22.974312 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:22.975624 (+ 1312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:22.975626 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:22.975626 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:22.975634 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:22.977174 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:22.977543 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:22.977544 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:22.977544 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:22.977606 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:22.977796 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:22.977797 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:22.977797 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:22.977924 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:22.978024 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:22.978100 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 02:23:22.978182 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":12,"server-negotiator.queue_time_us":19}
I20260809 02:23:22.980310 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 1066
2026-08-09T02:23:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1382 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:23 dist-test-slave-w206 krb5kdc[1173](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:23 dist-test-slave-w206 krb5kdc[1173](info): set up 2 sockets
Aug 09 02:23:23 dist-test-slave-w206 krb5kdc[1173](info): commencing operation
krb5kdc: starting...
W20260809 02:23:24.059391 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:23:24 dist-test-slave-w206 krb5kdc[1173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242204, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:23:24.189465 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33879
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33879
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:24.274627 1186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:24.274834 1186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:24.274866 1186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:24.276060 1186 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:24.276108 1186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:24.276121 1186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:24.276134 1186 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:24.276175 1186 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:24.277689 1186 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33879
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33879
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1186
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:24.277964 1186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:24.278205 1186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:24.283243 1191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:24.283301 1186 server_base.cc:1034] running on GCE node
W20260809 02:23:24.283253 1192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:24.283253 1196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:24.283805 1186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:24.284145 1186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:24.285322 1186 hybrid_clock.cc:648] HybridClock initialized: now 1786242204285277 us; error 61 us; skew 500 ppm
Aug 09 02:23:24 dist-test-slave-w206 krb5kdc[1173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242204, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:24.287949 1186 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:23:24.288442 1186 webserver.cc:460] Webserver started at http://127.0.0.1:35007/ using document root <none> and password file <none>
I20260809 02:23:24.288697 1186 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:24.288766 1186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:24.288920 1186 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:24.290035 1186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "ac00593cbe0f41daa6d9ca388cceec68"
format_stamp: "Formatted at 2026-08-09 02:23:24 on dist-test-slave-w206"
server_key: "c3d3d72eeea38a99c370d22cd7f5a8ac"
server_key_iv: "8619088fd68e42651861905c88a0095e"
server_key_version: "encryptionkey@0"
I20260809 02:23:24.290405 1186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "ac00593cbe0f41daa6d9ca388cceec68"
format_stamp: "Formatted at 2026-08-09 02:23:24 on dist-test-slave-w206"
server_key: "c3d3d72eeea38a99c370d22cd7f5a8ac"
server_key_iv: "8619088fd68e42651861905c88a0095e"
server_key_version: "encryptionkey@0"
I20260809 02:23:24.291927 1186 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:23:24.292699 1203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:24.292882 1186 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:23:24.292994 1186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "ac00593cbe0f41daa6d9ca388cceec68"
format_stamp: "Formatted at 2026-08-09 02:23:24 on dist-test-slave-w206"
server_key: "c3d3d72eeea38a99c370d22cd7f5a8ac"
server_key_iv: "8619088fd68e42651861905c88a0095e"
server_key_version: "encryptionkey@0"
I20260809 02:23:24.293069 1186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:24.318675 1186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:24.322193 1186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:24.322413 1186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:24.326695 1186 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33879
I20260809 02:23:24.326746 1260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33879 every 8 connection(s)
I20260809 02:23:24.327143 1186 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:24.328100 1261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:24.330449 1261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac00593cbe0f41daa6d9ca388cceec68: Bootstrap starting.
I20260809 02:23:24.331139 1261 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac00593cbe0f41daa6d9ca388cceec68: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:24.331427 1261 log.cc:824] T 00000000000000000000000000000000 P ac00593cbe0f41daa6d9ca388cceec68: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:24.332158 1261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac00593cbe0f41daa6d9ca388cceec68: No bootstrap required, opened a new log
I20260809 02:23:24.333727 1261 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac00593cbe0f41daa6d9ca388cceec68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac00593cbe0f41daa6d9ca388cceec68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33879 } }
I20260809 02:23:24.333909 1261 raft_consensus.cc:374] T 00000000000000000000000000000000 P ac00593cbe0f41daa6d9ca388cceec68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:24.333983 1261 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac00593cbe0f41daa6d9ca388cceec68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac00593cbe0f41daa6d9ca388cceec68, State: Initialized, Role: FOLLOWER
I20260809 02:23:24.334168 1261 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac00593cbe0f41daa6d9ca388cceec68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac00593cbe0f41daa6d9ca388cceec68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33879 } }
I20260809 02:23:24.334252 1261 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac00593cbe0f41daa6d9ca388cceec68 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:24.334301 1261 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac00593cbe0f41daa6d9ca388cceec68 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:24.334352 1261 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac00593cbe0f41daa6d9ca388cceec68 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:24.334888 1261 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac00593cbe0f41daa6d9ca388cceec68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac00593cbe0f41daa6d9ca388cceec68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33879 } }
I20260809 02:23:24.335031 1261 leader_election.cc:302] T 00000000000000000000000000000000 P ac00593cbe0f41daa6d9ca388cceec68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac00593cbe0f41daa6d9ca388cceec68; no voters:
I20260809 02:23:24.335266 1261 leader_election.cc:288] T 00000000000000000000000000000000 P ac00593cbe0f41daa6d9ca388cceec68 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:24.335289 1264 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac00593cbe0f41daa6d9ca388cceec68 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:24.335311 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 1186
I20260809 02:23:24.335481 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:24.335484 1264 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac00593cbe0f41daa6d9ca388cceec68 [term 1 LEADER]: Becoming Leader. State: Replica: ac00593cbe0f41daa6d9ca388cceec68, State: Running, Role: LEADER
I20260809 02:23:24.335565 1264 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac00593cbe0f41daa6d9ca388cceec68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac00593cbe0f41daa6d9ca388cceec68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33879 } }
I20260809 02:23:24.335599 1261 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac00593cbe0f41daa6d9ca388cceec68 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:24.335691 11638 external_mini_cluster.cc:1428] Setting key e9f9fd04c489a0b3e95af806fddf8286
I20260809 02:23:24.335891 1264 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac00593cbe0f41daa6d9ca388cceec68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac00593cbe0f41daa6d9ca388cceec68. Latest consensus state: current_term: 1 leader_uuid: "ac00593cbe0f41daa6d9ca388cceec68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac00593cbe0f41daa6d9ca388cceec68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33879 } } }
I20260809 02:23:24.336071 1264 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac00593cbe0f41daa6d9ca388cceec68 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:24.336359 1273 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:24.336768 1265 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac00593cbe0f41daa6d9ca388cceec68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ac00593cbe0f41daa6d9ca388cceec68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac00593cbe0f41daa6d9ca388cceec68" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33879 } } }
I20260809 02:23:24.336953 1265 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac00593cbe0f41daa6d9ca388cceec68 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:24.336964 1273 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:24.340314 1273 catalog_manager.cc:1347] Generated new cluster ID: 9c4cf8b80e3440188e1a41c9542a2c7b
I20260809 02:23:24.340394 1273 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:24.342612 1275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.336403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57155 (local address 127.0.0.1:33879)
0809 02:23:24.336615 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:24.336627 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:24.336981 (+ 354us) server_negotiation.cc:407] Connection header received
0809 02:23:24.337124 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:24.337132 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:24.337193 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:24.337738 (+ 545us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:24.337844 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.338889 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.340138 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.340916 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.341030 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:24.341835 (+ 805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:24.341839 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:24.341840 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:24.342056 (+ 216us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:24.342099 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:24.342115 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:24.342187 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:24.342285 (+ 98us) server_negotiation.cc:299] Negotiation successful
0809 02:23:24.342351 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":82,"threads_started":1}
I20260809 02:23:24.343616 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:23:24.348851 1275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:24.345160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41101 (local address 127.0.0.1:33879)
0809 02:23:24.345217 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:24.345219 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:24.345380 (+ 161us) server_negotiation.cc:407] Connection header received
0809 02:23:24.345410 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:24.345411 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:24.345422 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:24.345489 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:24.345615 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.346392 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.347463 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:24.347790 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:24.347851 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:24.348579 (+ 728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:24.348581 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:24.348581 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:24.348586 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:24.348601 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:24.348607 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:24.348662 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:24.348727 (+ 65us) server_negotiation.cc:299] Negotiation successful
0809 02:23:24.348750 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 02:23:24.366555 1273 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:24.367319 1273 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:24.378225 1273 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ac00593cbe0f41daa6d9ca388cceec68: Generated new TSK 0
I20260809 02:23:24.378501 1273 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:24.383937 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 1186
2026-08-09T02:23:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1402 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:24 dist-test-slave-w206 krb5kdc[1293](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:24 dist-test-slave-w206 krb5kdc[1293](info): set up 2 sockets
Aug 09 02:23:24 dist-test-slave-w206 krb5kdc[1293](info): commencing operation
krb5kdc: starting...
W20260809 02:23:25.457726 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.054s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:23:25 dist-test-slave-w206 krb5kdc[1293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242205, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:23:25.586159 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38785
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38785
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:25.669752 1307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:25.669960 1307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:25.669982 1307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:25.671236 1307 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:25.671277 1307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:25.671291 1307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:25.671304 1307 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:25.671316 1307 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:25.672804 1307 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38785
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1307
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:25.673064 1307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:25.673313 1307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:25.678310 1313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:25.678333 1312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:25.678424 1307 server_base.cc:1034] running on GCE node
W20260809 02:23:25.678309 1315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:25.678792 1307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:25.679108 1307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:25.680254 1307 hybrid_clock.cc:648] HybridClock initialized: now 1786242205680244 us; error 28 us; skew 500 ppm
Aug 09 02:23:25 dist-test-slave-w206 krb5kdc[1293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242205, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:25.688050 1307 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:23:25.688508 1307 webserver.cc:460] Webserver started at http://127.0.0.1:37973/ using document root <none> and password file <none>
I20260809 02:23:25.688737 1307 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:25.688799 1307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:25.688933 1307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:25.690110 1307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "6bd5db377f85457a8798e2b97de142dd"
format_stamp: "Formatted at 2026-08-09 02:23:25 on dist-test-slave-w206"
server_key: "568d2163cca6ed2c18387313537d21f1"
server_key_iv: "20e2225b823d3834b6d01ec5c18e9775"
server_key_version: "encryptionkey@0"
I20260809 02:23:25.690476 1307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "6bd5db377f85457a8798e2b97de142dd"
format_stamp: "Formatted at 2026-08-09 02:23:25 on dist-test-slave-w206"
server_key: "568d2163cca6ed2c18387313537d21f1"
server_key_iv: "20e2225b823d3834b6d01ec5c18e9775"
server_key_version: "encryptionkey@0"
I20260809 02:23:25.692050 1307 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:23:25.692948 1323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:25.693325 1307 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:25.693418 1307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "6bd5db377f85457a8798e2b97de142dd"
format_stamp: "Formatted at 2026-08-09 02:23:25 on dist-test-slave-w206"
server_key: "568d2163cca6ed2c18387313537d21f1"
server_key_iv: "20e2225b823d3834b6d01ec5c18e9775"
server_key_version: "encryptionkey@0"
I20260809 02:23:25.693540 1307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:25.697008 1307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:25.699359 1307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:25.699512 1307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:25.703753 1307 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38785
I20260809 02:23:25.703781 1378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38785 every 8 connection(s)
I20260809 02:23:25.704144 1307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:25.705017 1379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:25.707401 1379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6bd5db377f85457a8798e2b97de142dd: Bootstrap starting.
I20260809 02:23:25.707984 1379 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6bd5db377f85457a8798e2b97de142dd: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:25.708272 1379 log.cc:824] T 00000000000000000000000000000000 P 6bd5db377f85457a8798e2b97de142dd: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:25.709022 1379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6bd5db377f85457a8798e2b97de142dd: No bootstrap required, opened a new log
I20260809 02:23:25.710712 1379 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6bd5db377f85457a8798e2b97de142dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bd5db377f85457a8798e2b97de142dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38785 } }
I20260809 02:23:25.710882 1379 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6bd5db377f85457a8798e2b97de142dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:25.710935 1379 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6bd5db377f85457a8798e2b97de142dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bd5db377f85457a8798e2b97de142dd, State: Initialized, Role: FOLLOWER
I20260809 02:23:25.711146 1379 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6bd5db377f85457a8798e2b97de142dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bd5db377f85457a8798e2b97de142dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38785 } }
I20260809 02:23:25.711261 1379 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6bd5db377f85457a8798e2b97de142dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:25.711310 1379 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6bd5db377f85457a8798e2b97de142dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:25.711366 1379 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6bd5db377f85457a8798e2b97de142dd [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:25.711910 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 1307
I20260809 02:23:25.712060 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:25.712061 1379 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6bd5db377f85457a8798e2b97de142dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bd5db377f85457a8798e2b97de142dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38785 } }
I20260809 02:23:25.712182 1379 leader_election.cc:302] T 00000000000000000000000000000000 P 6bd5db377f85457a8798e2b97de142dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6bd5db377f85457a8798e2b97de142dd; no voters:
I20260809 02:23:25.712311 11638 external_mini_cluster.cc:1428] Setting key 7ca70b49e68cc7063212593979570bdb
I20260809 02:23:25.712368 1379 leader_election.cc:288] T 00000000000000000000000000000000 P 6bd5db377f85457a8798e2b97de142dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:25.712430 1382 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6bd5db377f85457a8798e2b97de142dd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:25.712621 1382 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6bd5db377f85457a8798e2b97de142dd [term 1 LEADER]: Becoming Leader. State: Replica: 6bd5db377f85457a8798e2b97de142dd, State: Running, Role: LEADER
I20260809 02:23:25.712695 1379 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6bd5db377f85457a8798e2b97de142dd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:25.712792 1382 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6bd5db377f85457a8798e2b97de142dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bd5db377f85457a8798e2b97de142dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38785 } }
I20260809 02:23:25.713238 1383 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bd5db377f85457a8798e2b97de142dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6bd5db377f85457a8798e2b97de142dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bd5db377f85457a8798e2b97de142dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38785 } } }
I20260809 02:23:25.713364 1383 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bd5db377f85457a8798e2b97de142dd [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:25.713529 1383 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bd5db377f85457a8798e2b97de142dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6bd5db377f85457a8798e2b97de142dd. Latest consensus state: current_term: 1 leader_uuid: "6bd5db377f85457a8798e2b97de142dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bd5db377f85457a8798e2b97de142dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38785 } } }
I20260809 02:23:25.713578 1383 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bd5db377f85457a8798e2b97de142dd [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:25.713971 1391 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:25.714576 1391 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:25.715687 1392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:25.713401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48435 (local address 127.0.0.1:38785)
0809 02:23:25.713872 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:25.713884 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:25.713924 (+ 40us) server_negotiation.cc:407] Connection header received
0809 02:23:25.714061 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:25.714069 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:25.714106 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:25.714269 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:25.715189 (+ 920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:25.715193 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:25.715194 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:25.715199 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:25.715254 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:25.715270 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:25.715347 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:25.715439 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 02:23:25.715482 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":89,"threads_started":1}
I20260809 02:23:25.716279 1391 catalog_manager.cc:1347] Generated new cluster ID: 84c43803c0cd4a6bb644142577c1fcda
I20260809 02:23:25.716338 1391 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:25.719350 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:23:25.722191 1392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:25.720943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40657 (local address 127.0.0.1:38785)
0809 02:23:25.720992 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:25.720994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:25.721140 (+ 146us) server_negotiation.cc:407] Connection header received
0809 02:23:25.721198 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:25.721199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:25.721205 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:25.721281 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:25.721924 (+ 643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:25.721925 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:25.721925 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:25.721929 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:25.721945 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:25.721950 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:25.722009 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:25.722094 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 02:23:25.722107 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 02:23:25.729192 1391 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:25.729369 1391 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:25.737072 1391 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6bd5db377f85457a8798e2b97de142dd: Generated new TSK 0
I20260809 02:23:25.737283 1391 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:25.744720 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 1307
2026-08-09T02:23:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1361 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:25 dist-test-slave-w206 krb5kdc[1411](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:25 dist-test-slave-w206 krb5kdc[1411](info): set up 2 sockets
Aug 09 02:23:25 dist-test-slave-w206 krb5kdc[1411](info): commencing operation
krb5kdc: starting...
W20260809 02:23:26.817425 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.052s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:23:26 dist-test-slave-w206 krb5kdc[1411](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242206, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:23:26.946442 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39083
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39083
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:27.029484 1424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:27.029721 1424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:27.029760 1424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:27.030876 1424 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:27.030946 1424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:27.030973 1424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:27.031013 1424 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:27.031068 1424 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:27.032541 1424 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39083
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1424
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:27.032805 1424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:27.033026 1424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:27.037967 1432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:27.037956 1429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:27.037957 1430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:27.038051 1424 server_base.cc:1034] running on GCE node
I20260809 02:23:27.038434 1424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:27.038717 1424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:27.039891 1424 hybrid_clock.cc:648] HybridClock initialized: now 1786242207039869 us; error 38 us; skew 500 ppm
Aug 09 02:23:27 dist-test-slave-w206 krb5kdc[1411](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242207, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:27.042502 1424 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:23:27.042956 1424 webserver.cc:460] Webserver started at http://127.0.0.1:46463/ using document root <none> and password file <none>
I20260809 02:23:27.043243 1424 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:27.043289 1424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:27.043486 1424 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:27.044548 1424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "6b44b206bc164486bc66a965c425ce29"
format_stamp: "Formatted at 2026-08-09 02:23:27 on dist-test-slave-w206"
server_key: "eee1c48911a8bfef90630b1dda24820f"
server_key_iv: "0b1a3fbced5eec49b0cd97fed9f68965"
server_key_version: "encryptionkey@0"
I20260809 02:23:27.044911 1424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "6b44b206bc164486bc66a965c425ce29"
format_stamp: "Formatted at 2026-08-09 02:23:27 on dist-test-slave-w206"
server_key: "eee1c48911a8bfef90630b1dda24820f"
server_key_iv: "0b1a3fbced5eec49b0cd97fed9f68965"
server_key_version: "encryptionkey@0"
I20260809 02:23:27.046291 1424 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:23:27.047118 1440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:27.047319 1424 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:23:27.047403 1424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "6b44b206bc164486bc66a965c425ce29"
format_stamp: "Formatted at 2026-08-09 02:23:27 on dist-test-slave-w206"
server_key: "eee1c48911a8bfef90630b1dda24820f"
server_key_iv: "0b1a3fbced5eec49b0cd97fed9f68965"
server_key_version: "encryptionkey@0"
I20260809 02:23:27.047456 1424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:27.064124 1424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:27.066226 1424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:27.066404 1424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:27.070389 1424 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39083
I20260809 02:23:27.070469 1497 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39083 every 8 connection(s)
I20260809 02:23:27.070824 1424 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:27.071806 1498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:27.072041 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 1424
I20260809 02:23:27.072157 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:27.072369 11638 external_mini_cluster.cc:1428] Setting key c4cbeea33b8295c5ba492137f00ea825
I20260809 02:23:27.074967 1498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b44b206bc164486bc66a965c425ce29: Bootstrap starting.
I20260809 02:23:27.075681 1498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b44b206bc164486bc66a965c425ce29: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:27.075999 1498 log.cc:824] T 00000000000000000000000000000000 P 6b44b206bc164486bc66a965c425ce29: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:27.076792 1498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b44b206bc164486bc66a965c425ce29: No bootstrap required, opened a new log
I20260809 02:23:27.079304 1498 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6b44b206bc164486bc66a965c425ce29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b44b206bc164486bc66a965c425ce29" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39083 } }
I20260809 02:23:27.079469 1498 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6b44b206bc164486bc66a965c425ce29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:27.079520 1498 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6b44b206bc164486bc66a965c425ce29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b44b206bc164486bc66a965c425ce29, State: Initialized, Role: FOLLOWER
I20260809 02:23:27.079676 1498 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b44b206bc164486bc66a965c425ce29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b44b206bc164486bc66a965c425ce29" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39083 } }
I20260809 02:23:27.079761 1498 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6b44b206bc164486bc66a965c425ce29 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:27.079811 1498 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6b44b206bc164486bc66a965c425ce29 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
Aug 09 02:23:27 dist-test-slave-w206 krb5kdc[1411](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242206, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 02:23:27.079871 1498 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6b44b206bc164486bc66a965c425ce29 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:27.080633 1498 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6b44b206bc164486bc66a965c425ce29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b44b206bc164486bc66a965c425ce29" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39083 } }
I20260809 02:23:27.080789 1498 leader_election.cc:302] T 00000000000000000000000000000000 P 6b44b206bc164486bc66a965c425ce29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6b44b206bc164486bc66a965c425ce29; no voters:
I20260809 02:23:27.081001 1498 leader_election.cc:288] T 00000000000000000000000000000000 P 6b44b206bc164486bc66a965c425ce29 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:27.081034 1503 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6b44b206bc164486bc66a965c425ce29 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:27.081146 1503 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6b44b206bc164486bc66a965c425ce29 [term 1 LEADER]: Becoming Leader. State: Replica: 6b44b206bc164486bc66a965c425ce29, State: Running, Role: LEADER
I20260809 02:23:27.081300 1498 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6b44b206bc164486bc66a965c425ce29 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:27.081569 1503 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6b44b206bc164486bc66a965c425ce29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b44b206bc164486bc66a965c425ce29" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39083 } }
I20260809 02:23:27.082032 1505 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b44b206bc164486bc66a965c425ce29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b44b206bc164486bc66a965c425ce29. Latest consensus state: current_term: 1 leader_uuid: "6b44b206bc164486bc66a965c425ce29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b44b206bc164486bc66a965c425ce29" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39083 } } }
I20260809 02:23:27.082123 1505 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b44b206bc164486bc66a965c425ce29 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:27.082448 1504 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b44b206bc164486bc66a965c425ce29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6b44b206bc164486bc66a965c425ce29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b44b206bc164486bc66a965c425ce29" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39083 } } }
I20260809 02:23:27.082535 1504 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b44b206bc164486bc66a965c425ce29 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:27.082777 1512 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:27.083714 1512 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:27.084575 1501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:27.073022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:40131 (local address 127.0.0.1:39083)
0809 02:23:27.073221 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:27.073231 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:27.073279 (+ 48us) server_negotiation.cc:407] Connection header received
0809 02:23:27.073792 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:27.073801 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:27.073870 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:27.074025 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:27.074740 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:27.076155 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:27.077087 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:27.077687 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:27.077827 (+ 140us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:27.080427 (+ 2600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:27.080431 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:27.080431 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:27.080441 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:27.082547 (+ 2106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:27.083145 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:27.083148 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:27.083149 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:27.083329 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:27.083614 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:27.083615 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:27.083615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:27.083936 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:27.084097 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:27.084261 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 02:23:27.084368 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":78,"threads_started":1}
I20260809 02:23:27.085638 1512 catalog_manager.cc:1347] Generated new cluster ID: ab82782860ca4da4ad594296f7415ee0
I20260809 02:23:27.085661 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:23:27.085690 1512 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:27.095053 1501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:27.087379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:55201 (local address 127.0.0.1:39083)
0809 02:23:27.087412 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:27.087413 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:27.087421 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:23:27.087468 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:27.087468 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:27.087477 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:27.087528 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:27.088166 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:27.088872 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:27.089970 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:27.090280 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:27.090337 (+ 57us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:27.091869 (+ 1532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:27.091870 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:27.091870 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:27.091877 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:27.093652 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:27.094090 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:27.094091 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:27.094091 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:27.094145 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:27.094402 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:27.094402 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:27.094403 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:27.094516 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:27.094606 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:27.094778 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 02:23:27.094842 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 02:23:27.105594 1512 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:27.106345 1512 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:27.110329 1512 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6b44b206bc164486bc66a965c425ce29: Generated new TSK 0
I20260809 02:23:27.110514 1512 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:27.116191 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 1424
W20260809 02:23:27.123191 1409 connection.cc:535] client connection to 127.0.0.1:39083 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39083): Connection reset by peer (error 104)
2026-08-09T02:23:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1372 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:27 dist-test-slave-w206 krb5kdc[1530](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:27 dist-test-slave-w206 krb5kdc[1530](info): set up 2 sockets
Aug 09 02:23:27 dist-test-slave-w206 krb5kdc[1530](info): commencing operation
krb5kdc: starting...
W20260809 02:23:28.190726 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.053s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:23:28 dist-test-slave-w206 krb5kdc[1530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242208, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:23:28.321724 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37831
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37831
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:28.405570 1543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:28.405813 1543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:28.405861 1543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:28.407094 1543 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:28.407156 1543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:28.407181 1543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:28.407210 1543 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:28.407240 1543 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:28.408715 1543 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37831
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37831
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1543
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:28.409001 1543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:28.409236 1543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:28.414198 1549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:28.414430 1548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:28.414448 1551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:28.414595 1543 server_base.cc:1034] running on GCE node
I20260809 02:23:28.414841 1543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:28.415184 1543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:28.416347 1543 hybrid_clock.cc:648] HybridClock initialized: now 1786242208416318 us; error 39 us; skew 500 ppm
Aug 09 02:23:28 dist-test-slave-w206 krb5kdc[1530](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242208, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:28.419337 1543 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:23:28.419862 1543 webserver.cc:460] Webserver started at http://127.0.0.1:35685/ using document root <none> and password file <none>
I20260809 02:23:28.420140 1543 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:28.420210 1543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:28.420359 1543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:28.421446 1543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "aa0acbb16fc943c08c29295072e3bab2"
format_stamp: "Formatted at 2026-08-09 02:23:28 on dist-test-slave-w206"
server_key: "3fe35c52a8c061618db0cfd6d0744989"
server_key_iv: "84720bbccd67f346ca69247567b072cb"
server_key_version: "encryptionkey@0"
I20260809 02:23:28.421808 1543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "aa0acbb16fc943c08c29295072e3bab2"
format_stamp: "Formatted at 2026-08-09 02:23:28 on dist-test-slave-w206"
server_key: "3fe35c52a8c061618db0cfd6d0744989"
server_key_iv: "84720bbccd67f346ca69247567b072cb"
server_key_version: "encryptionkey@0"
I20260809 02:23:28.423259 1543 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:23:28.424010 1558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:28.424201 1543 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:23:28.424309 1543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "aa0acbb16fc943c08c29295072e3bab2"
format_stamp: "Formatted at 2026-08-09 02:23:28 on dist-test-slave-w206"
server_key: "3fe35c52a8c061618db0cfd6d0744989"
server_key_iv: "84720bbccd67f346ca69247567b072cb"
server_key_version: "encryptionkey@0"
I20260809 02:23:28.424386 1543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:28.447355 1543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:28.449839 1543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:28.450013 1543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:28.454236 1543 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37831
I20260809 02:23:28.454278 1617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37831 every 8 connection(s)
I20260809 02:23:28.454679 1543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:28.455541 1618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:28.457298 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 1543
I20260809 02:23:28.457437 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:28.457623 11638 external_mini_cluster.cc:1428] Setting key 15c9767882ea4b4ba79ae5fcfa5e63a3
I20260809 02:23:28.458196 1618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa0acbb16fc943c08c29295072e3bab2: Bootstrap starting.
I20260809 02:23:28.458799 1618 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa0acbb16fc943c08c29295072e3bab2: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:28.459177 1618 log.cc:824] T 00000000000000000000000000000000 P aa0acbb16fc943c08c29295072e3bab2: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:28.459971 1618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa0acbb16fc943c08c29295072e3bab2: No bootstrap required, opened a new log
I20260809 02:23:28.462347 1618 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa0acbb16fc943c08c29295072e3bab2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa0acbb16fc943c08c29295072e3bab2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37831 } }
I20260809 02:23:28.462512 1618 raft_consensus.cc:374] T 00000000000000000000000000000000 P aa0acbb16fc943c08c29295072e3bab2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:28.462538 1618 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa0acbb16fc943c08c29295072e3bab2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0acbb16fc943c08c29295072e3bab2, State: Initialized, Role: FOLLOWER
I20260809 02:23:28.462781 1618 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa0acbb16fc943c08c29295072e3bab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa0acbb16fc943c08c29295072e3bab2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37831 } }
I20260809 02:23:28.462879 1618 raft_consensus.cc:388] T 00000000000000000000000000000000 P aa0acbb16fc943c08c29295072e3bab2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:28.462925 1618 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa0acbb16fc943c08c29295072e3bab2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:28.462998 1618 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa0acbb16fc943c08c29295072e3bab2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:28.463581 1621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:28.458166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:44607 (local address 127.0.0.1:37831)
0809 02:23:28.458390 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:28.458397 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:28.458423 (+ 26us) server_negotiation.cc:407] Connection header received
0809 02:23:28.458898 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:28.458907 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:28.459022 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:28.459154 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:28.459447 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:28.460503 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:28.461649 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:28.462033 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:28.462110 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:28.462919 (+ 809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:28.462923 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:28.462924 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:28.463149 (+ 225us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:28.463181 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:28.463192 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:28.463286 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:28.463387 (+ 101us) server_negotiation.cc:299] Negotiation successful
0809 02:23:28.463416 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":85,"threads_started":1}
I20260809 02:23:28.463647 1618 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa0acbb16fc943c08c29295072e3bab2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa0acbb16fc943c08c29295072e3bab2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37831 } }
I20260809 02:23:28.463798 1618 leader_election.cc:302] T 00000000000000000000000000000000 P aa0acbb16fc943c08c29295072e3bab2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa0acbb16fc943c08c29295072e3bab2; no voters:
I20260809 02:23:28.463971 1618 leader_election.cc:288] T 00000000000000000000000000000000 P aa0acbb16fc943c08c29295072e3bab2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:28.464010 1623 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aa0acbb16fc943c08c29295072e3bab2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:28.464200 1623 raft_consensus.cc:686] T 00000000000000000000000000000000 P aa0acbb16fc943c08c29295072e3bab2 [term 1 LEADER]: Becoming Leader. State: Replica: aa0acbb16fc943c08c29295072e3bab2, State: Running, Role: LEADER
I20260809 02:23:28.464246 1618 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa0acbb16fc943c08c29295072e3bab2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:28.464309 1623 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa0acbb16fc943c08c29295072e3bab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa0acbb16fc943c08c29295072e3bab2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37831 } }
I20260809 02:23:28.464546 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:23:28.464636 1623 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa0acbb16fc943c08c29295072e3bab2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa0acbb16fc943c08c29295072e3bab2. Latest consensus state: current_term: 1 leader_uuid: "aa0acbb16fc943c08c29295072e3bab2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa0acbb16fc943c08c29295072e3bab2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37831 } } }
I20260809 02:23:28.464704 1623 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa0acbb16fc943c08c29295072e3bab2 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:28.464857 1625 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa0acbb16fc943c08c29295072e3bab2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aa0acbb16fc943c08c29295072e3bab2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa0acbb16fc943c08c29295072e3bab2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37831 } } }
I20260809 02:23:28.464916 1625 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa0acbb16fc943c08c29295072e3bab2 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:28.465221 1628 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:28.465709 1628 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:28.467578 1628 catalog_manager.cc:1347] Generated new cluster ID: 56487d5f5426425e809595c259f4f468
I20260809 02:23:28.467635 1628 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:28.469726 1621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:28.466219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:46429 (local address 127.0.0.1:37831)
0809 02:23:28.466253 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:28.466255 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:28.466419 (+ 164us) server_negotiation.cc:407] Connection header received
0809 02:23:28.466463 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:28.466464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:28.466475 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:28.466534 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:28.466679 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:28.467363 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:28.468375 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:28.468709 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:28.468789 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:28.469475 (+ 686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:28.469477 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:28.469477 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:28.469481 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:28.469497 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:28.469501 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:28.469570 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:28.469642 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 02:23:28.469653 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":8,"server-negotiator.queue_time_us":18}
I20260809 02:23:28.494401 1628 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:28.494967 1628 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:28.498451 1628 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aa0acbb16fc943c08c29295072e3bab2: Generated new TSK 0
I20260809 02:23:28.498637 1628 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:28.508581 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 1543
W20260809 02:23:28.514720 1527 connection.cc:535] client connection to 127.0.0.1:37831 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37831): Connection reset by peer (error 104)
2026-08-09T02:23:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1391 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:28 dist-test-slave-w206 krb5kdc[1649](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:28 dist-test-slave-w206 krb5kdc[1649](info): set up 2 sockets
Aug 09 02:23:28 dist-test-slave-w206 krb5kdc[1649](info): commencing operation
krb5kdc: starting...
W20260809 02:23:29.573750 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.045s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:23:29 dist-test-slave-w206 krb5kdc[1649](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242209, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:23:29.701535 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40241
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40241
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:29.785573 1663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:29.785808 1663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:29.785837 1663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:29.787200 1663 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:29.787252 1663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:29.787271 1663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:29.787322 1663 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:29.787350 1663 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:29.788992 1663 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40241
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:29.789280 1663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:29.789537 1663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:29.794627 1671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:29.794641 1669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:29.794727 1668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:29.794925 1663 server_base.cc:1034] running on GCE node
I20260809 02:23:29.795184 1663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:29.795446 1663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:29.796588 1663 hybrid_clock.cc:648] HybridClock initialized: now 1786242209796575 us; error 29 us; skew 500 ppm
Aug 09 02:23:29 dist-test-slave-w206 krb5kdc[1649](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242209, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:29.799252 1663 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:23:29.799682 1663 webserver.cc:460] Webserver started at http://127.0.0.1:45453/ using document root <none> and password file <none>
I20260809 02:23:29.799927 1663 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:29.799974 1663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:29.800125 1663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:29.801185 1663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "f88bb901098143f8a809c16216d6db02"
format_stamp: "Formatted at 2026-08-09 02:23:29 on dist-test-slave-w206"
server_key: "e21418d084fde995c9c87ccbb1f229a6"
server_key_iv: "e4e57b0dfea20f0e2c0d10f6a483f766"
server_key_version: "encryptionkey@0"
I20260809 02:23:29.801597 1663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "f88bb901098143f8a809c16216d6db02"
format_stamp: "Formatted at 2026-08-09 02:23:29 on dist-test-slave-w206"
server_key: "e21418d084fde995c9c87ccbb1f229a6"
server_key_iv: "e4e57b0dfea20f0e2c0d10f6a483f766"
server_key_version: "encryptionkey@0"
I20260809 02:23:29.802945 1663 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:23:29.803750 1679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:29.803952 1663 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:23:29.804059 1663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "f88bb901098143f8a809c16216d6db02"
format_stamp: "Formatted at 2026-08-09 02:23:29 on dist-test-slave-w206"
server_key: "e21418d084fde995c9c87ccbb1f229a6"
server_key_iv: "e4e57b0dfea20f0e2c0d10f6a483f766"
server_key_version: "encryptionkey@0"
I20260809 02:23:29.804133 1663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:29.807587 1663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:29.809363 1663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:29.809517 1663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:29.813447 1663 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40241
I20260809 02:23:29.813519 1732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40241 every 8 connection(s)
I20260809 02:23:29.813827 1663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:29.814683 1733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:29.816627 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 1663
I20260809 02:23:29.816712 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:29.816919 11638 external_mini_cluster.cc:1428] Setting key c83e32faaed7c3bfe3e256e19bd8038c
I20260809 02:23:29.817155 1733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f88bb901098143f8a809c16216d6db02: Bootstrap starting.
I20260809 02:23:29.817842 1733 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f88bb901098143f8a809c16216d6db02: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:29.818130 1733 log.cc:824] T 00000000000000000000000000000000 P f88bb901098143f8a809c16216d6db02: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:29.818877 1733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f88bb901098143f8a809c16216d6db02: No bootstrap required, opened a new log
I20260809 02:23:29.819554 1736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:29.817414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:40381 (local address 127.0.0.1:40241)
0809 02:23:29.817619 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:29.817629 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:29.817666 (+ 37us) server_negotiation.cc:407] Connection header received
0809 02:23:29.818142 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:29.818148 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:29.818181 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:29.818357 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:29.819105 (+ 748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:29.819109 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:29.819109 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:29.819114 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:29.819160 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:29.819170 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:29.819259 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:29.819325 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 02:23:29.819366 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":91,"threads_started":1}
I20260809 02:23:29.820480 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:23:29.821274 1733 raft_consensus.cc:348] T 00000000000000000000000000000000 P f88bb901098143f8a809c16216d6db02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f88bb901098143f8a809c16216d6db02" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40241 } }
I20260809 02:23:29.821457 1733 raft_consensus.cc:374] T 00000000000000000000000000000000 P f88bb901098143f8a809c16216d6db02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:29.821507 1733 raft_consensus.cc:729] T 00000000000000000000000000000000 P f88bb901098143f8a809c16216d6db02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f88bb901098143f8a809c16216d6db02, State: Initialized, Role: FOLLOWER
I20260809 02:23:29.821636 1733 consensus_queue.cc:260] T 00000000000000000000000000000000 P f88bb901098143f8a809c16216d6db02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f88bb901098143f8a809c16216d6db02" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40241 } }
I20260809 02:23:29.821738 1733 raft_consensus.cc:388] T 00000000000000000000000000000000 P f88bb901098143f8a809c16216d6db02 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:29.821779 1733 raft_consensus.cc:482] T 00000000000000000000000000000000 P f88bb901098143f8a809c16216d6db02 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:29.821847 1733 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f88bb901098143f8a809c16216d6db02 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:29.822453 1733 raft_consensus.cc:504] T 00000000000000000000000000000000 P f88bb901098143f8a809c16216d6db02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f88bb901098143f8a809c16216d6db02" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40241 } }
I20260809 02:23:29.822563 1733 leader_election.cc:302] T 00000000000000000000000000000000 P f88bb901098143f8a809c16216d6db02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f88bb901098143f8a809c16216d6db02; no voters:
I20260809 02:23:29.822727 1733 leader_election.cc:288] T 00000000000000000000000000000000 P f88bb901098143f8a809c16216d6db02 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:29.822791 1744 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f88bb901098143f8a809c16216d6db02 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:29.823004 1744 raft_consensus.cc:686] T 00000000000000000000000000000000 P f88bb901098143f8a809c16216d6db02 [term 1 LEADER]: Becoming Leader. State: Replica: f88bb901098143f8a809c16216d6db02, State: Running, Role: LEADER
I20260809 02:23:29.823083 1736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:29.821877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:47149 (local address 127.0.0.1:40241)
0809 02:23:29.821915 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:29.821916 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:29.822057 (+ 141us) server_negotiation.cc:407] Connection header received
0809 02:23:29.822137 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:29.822138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:29.822143 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:29.822198 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:29.822809 (+ 611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:29.822810 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:29.822811 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:29.822815 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:29.822828 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:29.822846 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:29.822899 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:29.823018 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 02:23:29.823033 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 02:23:29.823102 1733 sys_catalog.cc:564] T 00000000000000000000000000000000 P f88bb901098143f8a809c16216d6db02 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:29.823139 1744 consensus_queue.cc:237] T 00000000000000000000000000000000 P f88bb901098143f8a809c16216d6db02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f88bb901098143f8a809c16216d6db02" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40241 } }
I20260809 02:23:29.823485 1744 sys_catalog.cc:455] T 00000000000000000000000000000000 P f88bb901098143f8a809c16216d6db02 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f88bb901098143f8a809c16216d6db02. Latest consensus state: current_term: 1 leader_uuid: "f88bb901098143f8a809c16216d6db02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f88bb901098143f8a809c16216d6db02" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40241 } } }
I20260809 02:23:29.823745 1744 sys_catalog.cc:458] T 00000000000000000000000000000000 P f88bb901098143f8a809c16216d6db02 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:29.823658 1746 sys_catalog.cc:455] T 00000000000000000000000000000000 P f88bb901098143f8a809c16216d6db02 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f88bb901098143f8a809c16216d6db02" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f88bb901098143f8a809c16216d6db02" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40241 } } }
I20260809 02:23:29.824128 1746 sys_catalog.cc:458] T 00000000000000000000000000000000 P f88bb901098143f8a809c16216d6db02 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:29.824149 1755 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:29.824658 1755 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:29.826154 1755 catalog_manager.cc:1347] Generated new cluster ID: c0f57fe70e584eb3bad27501ad63c0a2
I20260809 02:23:29.826206 1755 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:29.836050 1755 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:29.836218 1755 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:29.846026 1755 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f88bb901098143f8a809c16216d6db02: Generated new TSK 0
I20260809 02:23:29.846213 1755 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:29.850003 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 1663
2026-08-09T02:23:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1343 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:29 dist-test-slave-w206 krb5kdc[1769](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:29 dist-test-slave-w206 krb5kdc[1769](info): set up 2 sockets
Aug 09 02:23:29 dist-test-slave-w206 krb5kdc[1769](info): commencing operation
krb5kdc: starting...
W20260809 02:23:30.929986 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.058s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:23:31 dist-test-slave-w206 krb5kdc[1769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242211, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:23:31.058518 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42751
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42751
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:31.141811 1782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:31.142027 1782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:31.142050 1782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:31.143150 1782 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:31.143186 1782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:31.143200 1782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:31.143213 1782 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:31.143225 1782 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:31.144618 1782 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42751
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:31.144810 1782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:31.144979 1782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:31.149953 1787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:31.150000 1782 server_base.cc:1034] running on GCE node
W20260809 02:23:31.149984 1790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:31.150012 1788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:31.150421 1782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:31.150668 1782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:31.151908 1782 hybrid_clock.cc:648] HybridClock initialized: now 1786242211151889 us; error 39 us; skew 500 ppm
Aug 09 02:23:31 dist-test-slave-w206 krb5kdc[1769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242211, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:31.158021 1782 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:23:31.158550 1782 webserver.cc:460] Webserver started at http://127.0.0.1:40559/ using document root <none> and password file <none>
I20260809 02:23:31.158787 1782 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:31.158833 1782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:31.159042 1782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:31.160183 1782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "769ec3d0ab5b4a0cab34830245e4dc66"
format_stamp: "Formatted at 2026-08-09 02:23:31 on dist-test-slave-w206"
server_key: "6d5e3717b7d6782cbd71a25762856816"
server_key_iv: "c4d2bc22d0960a2c86a1803f61b1bb76"
server_key_version: "encryptionkey@0"
I20260809 02:23:31.160569 1782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "769ec3d0ab5b4a0cab34830245e4dc66"
format_stamp: "Formatted at 2026-08-09 02:23:31 on dist-test-slave-w206"
server_key: "6d5e3717b7d6782cbd71a25762856816"
server_key_iv: "c4d2bc22d0960a2c86a1803f61b1bb76"
server_key_version: "encryptionkey@0"
I20260809 02:23:31.162020 1782 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:23:31.162887 1797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:31.163136 1782 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:31.163244 1782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "769ec3d0ab5b4a0cab34830245e4dc66"
format_stamp: "Formatted at 2026-08-09 02:23:31 on dist-test-slave-w206"
server_key: "6d5e3717b7d6782cbd71a25762856816"
server_key_iv: "c4d2bc22d0960a2c86a1803f61b1bb76"
server_key_version: "encryptionkey@0"
I20260809 02:23:31.163345 1782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:31.194020 1782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:31.196133 1782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:31.196306 1782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:31.200579 1782 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42751
I20260809 02:23:31.200620 1851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42751 every 8 connection(s)
I20260809 02:23:31.201002 1782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:31.201853 1852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:31.204156 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 1782
I20260809 02:23:31.204280 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:31.204522 11638 external_mini_cluster.cc:1428] Setting key 47741d3d9dfc5206975b887d48af423c
I20260809 02:23:31.204718 1852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 769ec3d0ab5b4a0cab34830245e4dc66: Bootstrap starting.
I20260809 02:23:31.205482 1852 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 769ec3d0ab5b4a0cab34830245e4dc66: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:31.205787 1852 log.cc:824] T 00000000000000000000000000000000 P 769ec3d0ab5b4a0cab34830245e4dc66: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:31.206614 1852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 769ec3d0ab5b4a0cab34830245e4dc66: No bootstrap required, opened a new log
I20260809 02:23:31.208957 1852 raft_consensus.cc:348] T 00000000000000000000000000000000 P 769ec3d0ab5b4a0cab34830245e4dc66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "769ec3d0ab5b4a0cab34830245e4dc66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42751 } }
I20260809 02:23:31.209125 1852 raft_consensus.cc:374] T 00000000000000000000000000000000 P 769ec3d0ab5b4a0cab34830245e4dc66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:31.209156 1852 raft_consensus.cc:729] T 00000000000000000000000000000000 P 769ec3d0ab5b4a0cab34830245e4dc66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 769ec3d0ab5b4a0cab34830245e4dc66, State: Initialized, Role: FOLLOWER
I20260809 02:23:31.209285 1852 consensus_queue.cc:260] T 00000000000000000000000000000000 P 769ec3d0ab5b4a0cab34830245e4dc66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "769ec3d0ab5b4a0cab34830245e4dc66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42751 } }
I20260809 02:23:31.209357 1852 raft_consensus.cc:388] T 00000000000000000000000000000000 P 769ec3d0ab5b4a0cab34830245e4dc66 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:31.209386 1852 raft_consensus.cc:482] T 00000000000000000000000000000000 P 769ec3d0ab5b4a0cab34830245e4dc66 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:31.209432 1852 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 769ec3d0ab5b4a0cab34830245e4dc66 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:31.210088 1852 raft_consensus.cc:504] T 00000000000000000000000000000000 P 769ec3d0ab5b4a0cab34830245e4dc66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "769ec3d0ab5b4a0cab34830245e4dc66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42751 } }
I20260809 02:23:31.210220 1852 leader_election.cc:302] T 00000000000000000000000000000000 P 769ec3d0ab5b4a0cab34830245e4dc66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 769ec3d0ab5b4a0cab34830245e4dc66; no voters:
I20260809 02:23:31.210417 1852 leader_election.cc:288] T 00000000000000000000000000000000 P 769ec3d0ab5b4a0cab34830245e4dc66 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:31.210448 1858 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 769ec3d0ab5b4a0cab34830245e4dc66 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:31.210556 1858 raft_consensus.cc:686] T 00000000000000000000000000000000 P 769ec3d0ab5b4a0cab34830245e4dc66 [term 1 LEADER]: Becoming Leader. State: Replica: 769ec3d0ab5b4a0cab34830245e4dc66, State: Running, Role: LEADER
I20260809 02:23:31.210700 1858 consensus_queue.cc:237] T 00000000000000000000000000000000 P 769ec3d0ab5b4a0cab34830245e4dc66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "769ec3d0ab5b4a0cab34830245e4dc66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42751 } }
I20260809 02:23:31.210711 1852 sys_catalog.cc:564] T 00000000000000000000000000000000 P 769ec3d0ab5b4a0cab34830245e4dc66 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:31.211378 1859 sys_catalog.cc:455] T 00000000000000000000000000000000 P 769ec3d0ab5b4a0cab34830245e4dc66 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "769ec3d0ab5b4a0cab34830245e4dc66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "769ec3d0ab5b4a0cab34830245e4dc66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42751 } } }
I20260809 02:23:31.211465 1859 sys_catalog.cc:458] T 00000000000000000000000000000000 P 769ec3d0ab5b4a0cab34830245e4dc66 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:31.211431 1860 sys_catalog.cc:455] T 00000000000000000000000000000000 P 769ec3d0ab5b4a0cab34830245e4dc66 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 769ec3d0ab5b4a0cab34830245e4dc66. Latest consensus state: current_term: 1 leader_uuid: "769ec3d0ab5b4a0cab34830245e4dc66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "769ec3d0ab5b4a0cab34830245e4dc66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42751 } } }
I20260809 02:23:31.211521 1860 sys_catalog.cc:458] T 00000000000000000000000000000000 P 769ec3d0ab5b4a0cab34830245e4dc66 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:31.211805 1869 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 09 02:23:31 dist-test-slave-w206 krb5kdc[1769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242211, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 02:23:31.212381 1869 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:31.214077 1869 catalog_manager.cc:1347] Generated new cluster ID: 3e2c015606f84f47ac911e62dd602129
I20260809 02:23:31.214138 1869 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:31.216509 1856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:31.205071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:43005 (local address 127.0.0.1:42751)
0809 02:23:31.205254 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:31.205263 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:31.205297 (+ 34us) server_negotiation.cc:407] Connection header received
0809 02:23:31.205782 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:31.205789 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:31.205845 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:31.205993 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:31.206793 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:31.208189 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:31.208941 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:31.209558 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:31.209676 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:31.212911 (+ 3235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:31.212915 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:31.212916 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:31.212930 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:31.214799 (+ 1869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:31.215294 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:31.215297 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:31.215298 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:31.215408 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:31.215647 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:31.215648 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:31.215649 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:31.215893 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:31.216085 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:31.216182 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 02:23:31.216285 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":96,"threads_started":1}
I20260809 02:23:31.217569 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:23:31.233703 1856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:31.218959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:52767 (local address 127.0.0.1:42751)
0809 02:23:31.219018 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:31.219020 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:31.227208 (+ 8188us) server_negotiation.cc:407] Connection header received
0809 02:23:31.227315 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:31.227316 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:31.227328 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:31.227422 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:31.227993 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:31.228543 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:31.229281 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:31.229521 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:31.229600 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:31.230886 (+ 1286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:31.230888 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:31.230888 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:31.230895 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:31.232451 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:31.232840 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:31.232842 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:31.232842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:31.232913 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:31.233148 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:31.233150 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:31.233150 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:31.233269 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:31.233390 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:31.233512 (+ 122us) server_negotiation.cc:299] Negotiation successful
0809 02:23:31.233579 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":41}
I20260809 02:23:31.238390 1869 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:31.239157 1869 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:31.244912 1869 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 769ec3d0ab5b4a0cab34830245e4dc66: Generated new TSK 0
I20260809 02:23:31.245102 1869 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:31.253162 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 1782
W20260809 02:23:31.259891 1767 connection.cc:535] client connection to 127.0.0.1:42751 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42751): Connection reset by peer (error 104)
2026-08-09T02:23:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1401 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:31 dist-test-slave-w206 krb5kdc[1887](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:31 dist-test-slave-w206 krb5kdc[1887](info): set up 2 sockets
Aug 09 02:23:31 dist-test-slave-w206 krb5kdc[1887](info): commencing operation
krb5kdc: starting...
W20260809 02:23:32.354084 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:23:32 dist-test-slave-w206 krb5kdc[1887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242212, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:23:32.479900 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35553
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35553
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:32.562495 1900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:32.562747 1900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:32.562785 1900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:32.563959 1900 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:32.564036 1900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:32.564060 1900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:32.564081 1900 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:32.564112 1900 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:32.565593 1900 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35553
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1900
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:32.565877 1900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:32.566119 1900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:32.571585 1907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:32.571534 1909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:32.571537 1906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:32.571697 1900 server_base.cc:1034] running on GCE node
I20260809 02:23:32.572069 1900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:32.572355 1900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:32.573527 1900 hybrid_clock.cc:648] HybridClock initialized: now 1786242212573514 us; error 44 us; skew 500 ppm
Aug 09 02:23:32 dist-test-slave-w206 krb5kdc[1887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242212, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:32.576197 1900 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:23:32.576687 1900 webserver.cc:460] Webserver started at http://127.0.0.1:42629/ using document root <none> and password file <none>
I20260809 02:23:32.576941 1900 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:32.577013 1900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:32.577164 1900 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:32.578234 1900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "93dab7741daf463d9f41006e966408bf"
format_stamp: "Formatted at 2026-08-09 02:23:32 on dist-test-slave-w206"
server_key: "ee14de79449228947033d4ae997637dc"
server_key_iv: "e4dca2723412cc138be5fdfe14731b40"
server_key_version: "encryptionkey@0"
I20260809 02:23:32.578608 1900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "93dab7741daf463d9f41006e966408bf"
format_stamp: "Formatted at 2026-08-09 02:23:32 on dist-test-slave-w206"
server_key: "ee14de79449228947033d4ae997637dc"
server_key_iv: "e4dca2723412cc138be5fdfe14731b40"
server_key_version: "encryptionkey@0"
I20260809 02:23:32.580056 1900 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:23:32.580799 1916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:32.580983 1900 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:23:32.581076 1900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "93dab7741daf463d9f41006e966408bf"
format_stamp: "Formatted at 2026-08-09 02:23:32 on dist-test-slave-w206"
server_key: "ee14de79449228947033d4ae997637dc"
server_key_iv: "e4dca2723412cc138be5fdfe14731b40"
server_key_version: "encryptionkey@0"
I20260809 02:23:32.581161 1900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:32.591815 1900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:32.594247 1900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:32.594432 1900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:32.598644 1900 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35553
I20260809 02:23:32.598676 1969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35553 every 8 connection(s)
I20260809 02:23:32.599093 1900 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:32.600003 1970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:32.602273 1970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf: Bootstrap starting.
I20260809 02:23:32.602870 1970 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:32.603207 1970 log.cc:824] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:32.603935 1970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf: No bootstrap required, opened a new log
I20260809 02:23:32.605074 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 1900
I20260809 02:23:32.605189 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:32.605377 11638 external_mini_cluster.cc:1428] Setting key c43ef4536eb802be5a19fe84b35c1df6
I20260809 02:23:32.606191 1970 raft_consensus.cc:348] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93dab7741daf463d9f41006e966408bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35553 } }
I20260809 02:23:32.606328 1970 raft_consensus.cc:374] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:32.606354 1970 raft_consensus.cc:729] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93dab7741daf463d9f41006e966408bf, State: Initialized, Role: FOLLOWER
I20260809 02:23:32.606487 1970 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93dab7741daf463d9f41006e966408bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35553 } }
I20260809 02:23:32.606577 1970 raft_consensus.cc:388] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:32.606612 1970 raft_consensus.cc:482] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:32.606695 1970 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:32.607326 1970 raft_consensus.cc:504] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93dab7741daf463d9f41006e966408bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35553 } }
I20260809 02:23:32.607419 1970 leader_election.cc:302] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 93dab7741daf463d9f41006e966408bf; no voters:
I20260809 02:23:32.607594 1970 leader_election.cc:288] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:32.607648 1975 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:32.607784 1975 raft_consensus.cc:686] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf [term 1 LEADER]: Becoming Leader. State: Replica: 93dab7741daf463d9f41006e966408bf, State: Running, Role: LEADER
I20260809 02:23:32.607861 1970 sys_catalog.cc:564] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:32.607932 1975 consensus_queue.cc:237] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93dab7741daf463d9f41006e966408bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35553 } }
I20260809 02:23:32.608243 1975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93dab7741daf463d9f41006e966408bf. Latest consensus state: current_term: 1 leader_uuid: "93dab7741daf463d9f41006e966408bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93dab7741daf463d9f41006e966408bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35553 } } }
I20260809 02:23:32.608345 1975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:32.608258 1976 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "93dab7741daf463d9f41006e966408bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93dab7741daf463d9f41006e966408bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35553 } } }
I20260809 02:23:32.608523 1976 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf [sys.catalog]: This master's current role is: LEADER
W20260809 02:23:32.609751 1993 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:23:32.609813 1993 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:23:32.609864 1984 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:32.610018 1984 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:32.611578 1974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:32.606011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:60447 (local address 127.0.0.1:35553)
0809 02:23:32.606188 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:32.606196 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:32.606220 (+ 24us) server_negotiation.cc:407] Connection header received
0809 02:23:32.606317 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:32.606323 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:32.606410 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:32.606595 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:32.606955 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:32.608237 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:32.609466 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:32.609943 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:32.610047 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:32.610727 (+ 680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:32.610731 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:32.610731 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:32.610954 (+ 223us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:32.611025 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:32.611040 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:32.611135 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:32.611236 (+ 101us) server_negotiation.cc:299] Negotiation successful
0809 02:23:32.611383 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":90,"threads_started":1}
I20260809 02:23:32.611792 1984 catalog_manager.cc:1347] Generated new cluster ID: 2a636ce52e0d48819d87b5b82f72465e
I20260809 02:23:32.611840 1984 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:32.615501 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:23:32.620213 1974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:32.616935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:48871 (local address 127.0.0.1:35553)
0809 02:23:32.616974 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:32.616976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:32.617119 (+ 143us) server_negotiation.cc:407] Connection header received
0809 02:23:32.617194 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:32.617195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:32.617217 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:32.617268 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:32.617412 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:32.617870 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:32.618683 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:32.619091 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:32.619235 (+ 144us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:32.619966 (+ 731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:32.619967 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:32.619968 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:32.619972 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:32.619987 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:32.619991 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:32.620045 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:32.620105 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 02:23:32.620117 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 02:23:32.653729 1984 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:32.654479 1984 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:32.658389 1984 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 93dab7741daf463d9f41006e966408bf: Generated new TSK 0
I20260809 02:23:32.658573 1984 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:32.666571 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 1900
W20260809 02:23:32.673300 1885 connection.cc:535] client connection to 127.0.0.1:35553 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35553): Connection reset by peer (error 104)
2026-08-09T02:23:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1413 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:32 dist-test-slave-w206 krb5kdc[2003](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:32 dist-test-slave-w206 krb5kdc[2003](info): set up 2 sockets
Aug 09 02:23:32 dist-test-slave-w206 krb5kdc[2003](info): commencing operation
krb5kdc: starting...
W20260809 02:23:33.758680 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:23:33 dist-test-slave-w206 krb5kdc[2003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242213, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:23:33.881767 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36981
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36981
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:33.963583 2016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:33.963843 2016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:33.963884 2016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:33.965051 2016 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:33.965131 2016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:33.965157 2016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:33.965180 2016 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:33.965209 2016 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:33.966671 2016 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36981
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:33.966964 2016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:33.967222 2016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:33.972150 2023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:33.972160 2024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:33.972136 2026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:33.972421 2016 server_base.cc:1034] running on GCE node
I20260809 02:23:33.972643 2016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:33.972898 2016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:33.974042 2016 hybrid_clock.cc:648] HybridClock initialized: now 1786242213974031 us; error 31 us; skew 500 ppm
Aug 09 02:23:33 dist-test-slave-w206 krb5kdc[2003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242213, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:33.976559 2016 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:23:33.977056 2016 webserver.cc:460] Webserver started at http://127.0.0.1:33111/ using document root <none> and password file <none>
I20260809 02:23:33.977296 2016 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:33.977372 2016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:33.977535 2016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:33.978606 2016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "d21834bf5d4745a6918e48cd8ac7e6f0"
format_stamp: "Formatted at 2026-08-09 02:23:33 on dist-test-slave-w206"
server_key: "a0858908f53201b2b8c8e37187939fc3"
server_key_iv: "5b9e679f81e46f1912a349a6c637ea43"
server_key_version: "encryptionkey@0"
I20260809 02:23:33.979034 2016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "d21834bf5d4745a6918e48cd8ac7e6f0"
format_stamp: "Formatted at 2026-08-09 02:23:33 on dist-test-slave-w206"
server_key: "a0858908f53201b2b8c8e37187939fc3"
server_key_iv: "5b9e679f81e46f1912a349a6c637ea43"
server_key_version: "encryptionkey@0"
I20260809 02:23:33.980422 2016 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:23:33.981161 2033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:33.981380 2016 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:33.981503 2016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "d21834bf5d4745a6918e48cd8ac7e6f0"
format_stamp: "Formatted at 2026-08-09 02:23:33 on dist-test-slave-w206"
server_key: "a0858908f53201b2b8c8e37187939fc3"
server_key_iv: "5b9e679f81e46f1912a349a6c637ea43"
server_key_version: "encryptionkey@0"
I20260809 02:23:33.981602 2016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:33.985170 2016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:33.987259 2016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:33.987427 2016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:33.991837 2016 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36981
I20260809 02:23:33.991885 2090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36981 every 8 connection(s)
I20260809 02:23:33.992264 2016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:33.993135 2091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:33.995498 2091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d21834bf5d4745a6918e48cd8ac7e6f0: Bootstrap starting.
I20260809 02:23:33.996120 2091 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d21834bf5d4745a6918e48cd8ac7e6f0: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:33.996412 2091 log.cc:824] T 00000000000000000000000000000000 P d21834bf5d4745a6918e48cd8ac7e6f0: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:33.997182 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 2016
I20260809 02:23:33.997239 2091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d21834bf5d4745a6918e48cd8ac7e6f0: No bootstrap required, opened a new log
I20260809 02:23:33.997308 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:33.997512 11638 external_mini_cluster.cc:1428] Setting key 8aafa322df182b9892e2c95badb9b5e9
I20260809 02:23:33.999320 2091 raft_consensus.cc:348] T 00000000000000000000000000000000 P d21834bf5d4745a6918e48cd8ac7e6f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d21834bf5d4745a6918e48cd8ac7e6f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36981 } }
I20260809 02:23:33.999486 2091 raft_consensus.cc:374] T 00000000000000000000000000000000 P d21834bf5d4745a6918e48cd8ac7e6f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:33.999529 2091 raft_consensus.cc:729] T 00000000000000000000000000000000 P d21834bf5d4745a6918e48cd8ac7e6f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d21834bf5d4745a6918e48cd8ac7e6f0, State: Initialized, Role: FOLLOWER
I20260809 02:23:34.000057 2091 consensus_queue.cc:260] T 00000000000000000000000000000000 P d21834bf5d4745a6918e48cd8ac7e6f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d21834bf5d4745a6918e48cd8ac7e6f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36981 } }
I20260809 02:23:34.000190 2091 raft_consensus.cc:388] T 00000000000000000000000000000000 P d21834bf5d4745a6918e48cd8ac7e6f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:34.000231 2091 raft_consensus.cc:482] T 00000000000000000000000000000000 P d21834bf5d4745a6918e48cd8ac7e6f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:34.000290 2091 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d21834bf5d4745a6918e48cd8ac7e6f0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:34.000789 2095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:33.998103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:54857 (local address 127.0.0.1:36981)
0809 02:23:33.998280 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:33.998288 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:33.998313 (+ 25us) server_negotiation.cc:407] Connection header received
0809 02:23:33.999301 (+ 988us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:33.999308 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:33.999347 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:33.999465 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:34.000266 (+ 801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:34.000271 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:34.000271 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:34.000276 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:34.000348 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:34.000364 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:34.000440 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:34.000525 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 02:23:34.000584 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":84,"threads_started":1}
I20260809 02:23:34.001410 2091 raft_consensus.cc:504] T 00000000000000000000000000000000 P d21834bf5d4745a6918e48cd8ac7e6f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d21834bf5d4745a6918e48cd8ac7e6f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36981 } }
I20260809 02:23:34.001554 2091 leader_election.cc:302] T 00000000000000000000000000000000 P d21834bf5d4745a6918e48cd8ac7e6f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d21834bf5d4745a6918e48cd8ac7e6f0; no voters:
I20260809 02:23:34.001724 2091 leader_election.cc:288] T 00000000000000000000000000000000 P d21834bf5d4745a6918e48cd8ac7e6f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:34.001746 2096 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d21834bf5d4745a6918e48cd8ac7e6f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:34.001837 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:23:34.001948 2096 raft_consensus.cc:686] T 00000000000000000000000000000000 P d21834bf5d4745a6918e48cd8ac7e6f0 [term 1 LEADER]: Becoming Leader. State: Replica: d21834bf5d4745a6918e48cd8ac7e6f0, State: Running, Role: LEADER
I20260809 02:23:34.002032 2091 sys_catalog.cc:564] T 00000000000000000000000000000000 P d21834bf5d4745a6918e48cd8ac7e6f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:34.002036 2096 consensus_queue.cc:237] T 00000000000000000000000000000000 P d21834bf5d4745a6918e48cd8ac7e6f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d21834bf5d4745a6918e48cd8ac7e6f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36981 } }
I20260809 02:23:34.002422 2097 sys_catalog.cc:455] T 00000000000000000000000000000000 P d21834bf5d4745a6918e48cd8ac7e6f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d21834bf5d4745a6918e48cd8ac7e6f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d21834bf5d4745a6918e48cd8ac7e6f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36981 } } }
I20260809 02:23:34.002501 2097 sys_catalog.cc:458] T 00000000000000000000000000000000 P d21834bf5d4745a6918e48cd8ac7e6f0 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:34.002655 2098 sys_catalog.cc:455] T 00000000000000000000000000000000 P d21834bf5d4745a6918e48cd8ac7e6f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d21834bf5d4745a6918e48cd8ac7e6f0. Latest consensus state: current_term: 1 leader_uuid: "d21834bf5d4745a6918e48cd8ac7e6f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d21834bf5d4745a6918e48cd8ac7e6f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36981 } } }
I20260809 02:23:34.002737 2098 sys_catalog.cc:458] T 00000000000000000000000000000000 P d21834bf5d4745a6918e48cd8ac7e6f0 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:34.003067 2103 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:34.003566 2103 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:34.004922 2095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:34.003660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.133:52777 (local address 127.0.0.1:36981)
0809 02:23:34.003692 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:34.003694 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:34.003703 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:23:34.003793 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:34.003794 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:34.003799 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:34.003829 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:34.004655 (+ 826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:34.004656 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:34.004656 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:34.004661 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:34.004677 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:34.004681 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:34.004748 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:34.004816 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 02:23:34.004829 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 02:23:34.005290 2103 catalog_manager.cc:1347] Generated new cluster ID: 25f8b454106a48f582f0a03448467458
I20260809 02:23:34.005336 2103 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:34.016991 2103 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:34.017175 2103 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:34.019410 2103 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d21834bf5d4745a6918e48cd8ac7e6f0: Generated new TSK 0
I20260809 02:23:34.019588 2103 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:34.022948 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 2016
2026-08-09T02:23:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1356 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:34 dist-test-slave-w206 krb5kdc[2123](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:34 dist-test-slave-w206 krb5kdc[2123](info): set up 2 sockets
Aug 09 02:23:34 dist-test-slave-w206 krb5kdc[2123](info): commencing operation
krb5kdc: starting...
W20260809 02:23:35.089993 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.047s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:23:35 dist-test-slave-w206 krb5kdc[2123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242215, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:23:35.218319 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:41697
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:40637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:41697
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:35.300282 2139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:35.300532 2139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:35.300575 2139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:35.301746 2139 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:35.301819 2139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:35.301842 2139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:35.301864 2139 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:35.301892 2139 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:35.303455 2139 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:40637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:41697
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:41697
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2139
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:35.303745 2139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:35.303984 2139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:35.309172 2145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:35.309222 2144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:35.309199 2147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:35.309615 2139 server_base.cc:1034] running on GCE node
I20260809 02:23:35.309870 2139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:35.310190 2139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:35.311359 2139 hybrid_clock.cc:648] HybridClock initialized: now 1786242215311351 us; error 39 us; skew 500 ppm
Aug 09 02:23:35 dist-test-slave-w206 krb5kdc[2123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242215, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:35.313997 2139 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:23:35.314388 2139 webserver.cc:460] Webserver started at http://127.11.93.190:45545/ using document root <none> and password file <none>
I20260809 02:23:35.314585 2139 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:35.314625 2139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:35.314710 2139 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:35.315783 2139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "0c02d8d289344bde9e66332dc7247c58"
format_stamp: "Formatted at 2026-08-09 02:23:35 on dist-test-slave-w206"
server_key: "74bec517d013c947aa37e938b7b283ca"
server_key_iv: "d533249b06bb4cd42c5e3fb958381e70"
server_key_version: "encryptionkey@0"
I20260809 02:23:35.316087 2139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "0c02d8d289344bde9e66332dc7247c58"
format_stamp: "Formatted at 2026-08-09 02:23:35 on dist-test-slave-w206"
server_key: "74bec517d013c947aa37e938b7b283ca"
server_key_iv: "d533249b06bb4cd42c5e3fb958381e70"
server_key_version: "encryptionkey@0"
I20260809 02:23:35.317337 2139 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 02:23:35.318002 2154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:35.318198 2139 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:23:35.318287 2139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "0c02d8d289344bde9e66332dc7247c58"
format_stamp: "Formatted at 2026-08-09 02:23:35 on dist-test-slave-w206"
server_key: "74bec517d013c947aa37e938b7b283ca"
server_key_iv: "d533249b06bb4cd42c5e3fb958381e70"
server_key_version: "encryptionkey@0"
I20260809 02:23:35.318347 2139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:35.331027 2139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:35.333333 2139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:35.333449 2139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:35.337352 2139 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:41697
I20260809 02:23:35.337457 2210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:41697 every 8 connection(s)
I20260809 02:23:35.337754 2139 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:35.338649 2211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:35.340982 2211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c02d8d289344bde9e66332dc7247c58: Bootstrap starting.
I20260809 02:23:35.341548 2211 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c02d8d289344bde9e66332dc7247c58: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:35.341847 2211 log.cc:824] T 00000000000000000000000000000000 P 0c02d8d289344bde9e66332dc7247c58: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:35.342527 2211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c02d8d289344bde9e66332dc7247c58: No bootstrap required, opened a new log
I20260809 02:23:35.343863 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 2139
I20260809 02:23:35.343988 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:35.344192 11638 external_mini_cluster.cc:1428] Setting key 5e94ef3dfa39e36d801dc3129d98a9e0
I20260809 02:23:35.344595 2211 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c02d8d289344bde9e66332dc7247c58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c02d8d289344bde9e66332dc7247c58" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41697 } }
I20260809 02:23:35.344884 2211 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c02d8d289344bde9e66332dc7247c58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:35.344969 2211 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c02d8d289344bde9e66332dc7247c58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c02d8d289344bde9e66332dc7247c58, State: Initialized, Role: FOLLOWER
I20260809 02:23:35.345103 2211 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c02d8d289344bde9e66332dc7247c58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c02d8d289344bde9e66332dc7247c58" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41697 } }
I20260809 02:23:35.345204 2211 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c02d8d289344bde9e66332dc7247c58 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:35.345263 2211 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c02d8d289344bde9e66332dc7247c58 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:35.345317 2211 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c02d8d289344bde9e66332dc7247c58 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:35.346146 2211 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c02d8d289344bde9e66332dc7247c58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c02d8d289344bde9e66332dc7247c58" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41697 } }
I20260809 02:23:35.346266 2211 leader_election.cc:302] T 00000000000000000000000000000000 P 0c02d8d289344bde9e66332dc7247c58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c02d8d289344bde9e66332dc7247c58; no voters:
I20260809 02:23:35.346480 2211 leader_election.cc:288] T 00000000000000000000000000000000 P 0c02d8d289344bde9e66332dc7247c58 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:35.346517 2216 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c02d8d289344bde9e66332dc7247c58 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:35.346623 2216 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c02d8d289344bde9e66332dc7247c58 [term 1 LEADER]: Becoming Leader. State: Replica: 0c02d8d289344bde9e66332dc7247c58, State: Running, Role: LEADER
I20260809 02:23:35.346743 2211 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c02d8d289344bde9e66332dc7247c58 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:35.346760 2216 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c02d8d289344bde9e66332dc7247c58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c02d8d289344bde9e66332dc7247c58" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41697 } }
I20260809 02:23:35.347157 2216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c02d8d289344bde9e66332dc7247c58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c02d8d289344bde9e66332dc7247c58. Latest consensus state: current_term: 1 leader_uuid: "0c02d8d289344bde9e66332dc7247c58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c02d8d289344bde9e66332dc7247c58" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41697 } } }
I20260809 02:23:35.347167 2217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c02d8d289344bde9e66332dc7247c58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c02d8d289344bde9e66332dc7247c58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c02d8d289344bde9e66332dc7247c58" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 41697 } } }
I20260809 02:23:35.347347 2216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c02d8d289344bde9e66332dc7247c58 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:35.347363 2217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c02d8d289344bde9e66332dc7247c58 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:35.347649 2225 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:35.348217 2225 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:35.349915 2225 catalog_manager.cc:1347] Generated new cluster ID: 99995db2f0e94453a0c12160d055f048
I20260809 02:23:35.349982 2225 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 02:23:35 dist-test-slave-w206 krb5kdc[2123](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242215, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:23:35.355994 2215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:35.344703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36469 (local address 127.11.93.190:41697)
0809 02:23:35.344899 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:35.344907 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:35.344932 (+ 25us) server_negotiation.cc:407] Connection header received
0809 02:23:35.345053 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:35.345060 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:35.345112 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:35.345255 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:35.345938 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:35.347184 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:35.348328 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:35.348850 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:35.348980 (+ 130us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:35.351922 (+ 2942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:35.351926 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:35.351926 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:35.351937 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:35.353877 (+ 1940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:35.354343 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:35.354345 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:35.354346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:35.354463 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:35.354712 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:35.354713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:35.354714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:35.355388 (+ 674us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:35.355544 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:35.355706 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 02:23:35.355806 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":106,"threads_started":1}
I20260809 02:23:35.357241 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:23:35.359025 2225 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:35.359745 2225 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:35.365666 2215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:35.358837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56665 (local address 127.11.93.190:41697)
0809 02:23:35.358870 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:35.358872 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:35.359044 (+ 172us) server_negotiation.cc:407] Connection header received
0809 02:23:35.359108 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:35.359109 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:35.359119 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:35.359174 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:35.359713 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:35.360260 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:35.360954 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:35.361189 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:35.361275 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:35.362470 (+ 1195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:35.362471 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:35.362472 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:35.362479 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:35.364234 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:35.364678 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:35.364679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:35.364679 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:35.364739 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:35.365031 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:35.365032 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:35.365032 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:35.365170 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:35.365246 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:35.365496 (+ 250us) server_negotiation.cc:299] Negotiation successful
0809 02:23:35.365561 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260809 02:23:35.370688 2225 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c02d8d289344bde9e66332dc7247c58: Generated new TSK 0
I20260809 02:23:35.370896 2225 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:35.373831 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 2139
W20260809 02:23:35.379612 2121 connection.cc:535] client connection to 127.11.93.190:41697 recv error: Network error: failed to read from TLS socket (remote: 127.11.93.190:41697): Connection reset by peer (error 104)
2026-08-09T02:23:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1349 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:35 dist-test-slave-w206 krb5kdc[2242](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:35 dist-test-slave-w206 krb5kdc[2242](info): set up 2 sockets
Aug 09 02:23:35 dist-test-slave-w206 krb5kdc[2242](info): commencing operation
krb5kdc: starting...
W20260809 02:23:36.450174 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.057s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:23:36 dist-test-slave-w206 krb5kdc[2242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242216, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:23:36.573869 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:33175
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:43423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:33175
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:36.656977 2256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:36.657202 2256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:36.657228 2256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:36.658299 2256 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:36.658339 2256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:36.658356 2256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:36.658370 2256 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:36.658385 2256 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:36.659986 2256 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:43423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:33175
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:33175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:36.660204 2256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:36.660375 2256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:36.665367 2264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:36.665367 2262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:36.665380 2261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:36.665935 2256 server_base.cc:1034] running on GCE node
I20260809 02:23:36.666131 2256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:36.666373 2256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:36.667557 2256 hybrid_clock.cc:648] HybridClock initialized: now 1786242216667535 us; error 33 us; skew 500 ppm
Aug 09 02:23:36 dist-test-slave-w206 krb5kdc[2242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242216, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:36.675261 2256 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:23:36.675788 2256 webserver.cc:460] Webserver started at http://127.11.93.190:37113/ using document root <none> and password file <none>
I20260809 02:23:36.676043 2256 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:36.676115 2256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:36.676272 2256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:36.677345 2256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "3c40d21085b54664b4b2acd6f45f383d"
format_stamp: "Formatted at 2026-08-09 02:23:36 on dist-test-slave-w206"
server_key: "ef7d76acc7309513a619653e478fd81b"
server_key_iv: "f60ffb184a651c20a7d23651e20f8871"
server_key_version: "encryptionkey@0"
I20260809 02:23:36.677728 2256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "3c40d21085b54664b4b2acd6f45f383d"
format_stamp: "Formatted at 2026-08-09 02:23:36 on dist-test-slave-w206"
server_key: "ef7d76acc7309513a619653e478fd81b"
server_key_iv: "f60ffb184a651c20a7d23651e20f8871"
server_key_version: "encryptionkey@0"
I20260809 02:23:36.679150 2256 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:23:36.679915 2271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:36.680114 2256 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:36.680205 2256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "3c40d21085b54664b4b2acd6f45f383d"
format_stamp: "Formatted at 2026-08-09 02:23:36 on dist-test-slave-w206"
server_key: "ef7d76acc7309513a619653e478fd81b"
server_key_iv: "f60ffb184a651c20a7d23651e20f8871"
server_key_version: "encryptionkey@0"
I20260809 02:23:36.680261 2256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:36.700855 2256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:36.703277 2256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:36.703398 2256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:36.707376 2256 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:33175
I20260809 02:23:36.707413 2326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:33175 every 8 connection(s)
I20260809 02:23:36.707775 2256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:36.708658 2327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:36.708909 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 2256
I20260809 02:23:36.709048 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:36.709245 11638 external_mini_cluster.cc:1428] Setting key c5575c86ed1abf398c334f146da5f231
I20260809 02:23:36.711898 2327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d: Bootstrap starting.
I20260809 02:23:36.712585 2327 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:36.712895 2327 log.cc:824] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:36.713613 2327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d: No bootstrap required, opened a new log
I20260809 02:23:36.715433 2330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:36.709780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42271 (local address 127.11.93.190:33175)
0809 02:23:36.710078 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:36.710088 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:36.710120 (+ 32us) server_negotiation.cc:407] Connection header received
0809 02:23:36.710634 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:36.710643 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:36.710704 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:36.710859 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:36.711099 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:36.712448 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:36.713313 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:36.713784 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:36.713875 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:36.714579 (+ 704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:36.714582 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:36.714583 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:36.714739 (+ 156us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:36.714799 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:36.714815 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:36.714900 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:36.715093 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 02:23:36.715122 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":93,"threads_started":1}
I20260809 02:23:36.715623 2327 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c40d21085b54664b4b2acd6f45f383d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33175 } }
I20260809 02:23:36.715796 2327 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:36.715834 2327 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c40d21085b54664b4b2acd6f45f383d, State: Initialized, Role: FOLLOWER
I20260809 02:23:36.715955 2327 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c40d21085b54664b4b2acd6f45f383d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33175 } }
I20260809 02:23:36.716022 2327 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:36.716068 2327 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:36.716106 2327 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:36.716481 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:23:36.716787 2327 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c40d21085b54664b4b2acd6f45f383d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33175 } }
I20260809 02:23:36.716903 2327 leader_election.cc:302] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c40d21085b54664b4b2acd6f45f383d; no voters:
I20260809 02:23:36.717072 2327 leader_election.cc:288] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:36.717118 2332 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:36.717279 2332 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d [term 1 LEADER]: Becoming Leader. State: Replica: 3c40d21085b54664b4b2acd6f45f383d, State: Running, Role: LEADER
I20260809 02:23:36.717324 2327 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:36.717449 2332 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c40d21085b54664b4b2acd6f45f383d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33175 } }
I20260809 02:23:36.717974 2333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c40d21085b54664b4b2acd6f45f383d. Latest consensus state: current_term: 1 leader_uuid: "3c40d21085b54664b4b2acd6f45f383d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c40d21085b54664b4b2acd6f45f383d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33175 } } }
I20260809 02:23:36.718061 2333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:36.718691 2334 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c40d21085b54664b4b2acd6f45f383d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c40d21085b54664b4b2acd6f45f383d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 33175 } } }
I20260809 02:23:36.718770 2334 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d [sys.catalog]: This master's current role is: LEADER
W20260809 02:23:36.719587 2354 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:23:36.719650 2354 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:23:36.719740 2343 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:36.719962 2343 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:36.721513 2343 catalog_manager.cc:1347] Generated new cluster ID: 9a5ad6bb801e49c4a98501864f176012
I20260809 02:23:36.721575 2343 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:36.721830 2330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:36.718241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52583 (local address 127.11.93.190:33175)
0809 02:23:36.718308 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:36.718310 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:36.718318 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:23:36.718337 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:36.718338 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:36.718347 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:36.718403 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:36.718637 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:36.719418 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:36.720432 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:36.720718 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:36.720794 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:36.721540 (+ 746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:36.721542 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:36.721542 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:36.721547 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:36.721563 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:36.721567 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:36.721620 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:36.721747 (+ 127us) server_negotiation.cc:299] Negotiation successful
0809 02:23:36.721759 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:23:36.726521 2343 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:36.727146 2343 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:36.733098 2343 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c40d21085b54664b4b2acd6f45f383d: Generated new TSK 0
I20260809 02:23:36.733299 2343 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:36.739306 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 2256
W20260809 02:23:36.745369 2240 connection.cc:535] client connection to 127.11.93.190:33175 recv error: Network error: failed to read from TLS socket (remote: 127.11.93.190:33175): Connection reset by peer (error 104)
2026-08-09T02:23:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1365 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:36 dist-test-slave-w206 krb5kdc[2359](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:36 dist-test-slave-w206 krb5kdc[2359](info): set up 2 sockets
Aug 09 02:23:36 dist-test-slave-w206 krb5kdc[2359](info): commencing operation
krb5kdc: starting...
W20260809 02:23:37.805464 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:23:37 dist-test-slave-w206 krb5kdc[2359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242217, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:23:37.930051 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:42671
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:42085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:42671
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:38.010959 2372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:38.011197 2372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:38.011220 2372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:38.012297 2372 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:38.012341 2372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:38.012356 2372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:38.012369 2372 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:38.012382 2372 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:38.013837 2372 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:42085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:42671
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:42671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:38.014038 2372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:38.014207 2372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:23:38.019373 2372 server_base.cc:1034] running on GCE node
W20260809 02:23:38.019328 2380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:38.019304 2377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:38.019317 2378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:38.019740 2372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:38.020056 2372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:38.021202 2372 hybrid_clock.cc:648] HybridClock initialized: now 1786242218021183 us; error 36 us; skew 500 ppm
Aug 09 02:23:38 dist-test-slave-w206 krb5kdc[2359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242218, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:38.023869 2372 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:23:38.024336 2372 webserver.cc:460] Webserver started at http://127.11.93.190:38081/ using document root <none> and password file <none>
I20260809 02:23:38.024585 2372 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:38.024629 2372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:38.024791 2372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:38.025851 2372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "3b9e276f64914e9e8fdac25f20a7844a"
format_stamp: "Formatted at 2026-08-09 02:23:38 on dist-test-slave-w206"
server_key: "2fe578e428e65081f4080590486e5116"
server_key_iv: "fc7d327d98989255603e503206d85a6b"
server_key_version: "encryptionkey@0"
I20260809 02:23:38.026212 2372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "3b9e276f64914e9e8fdac25f20a7844a"
format_stamp: "Formatted at 2026-08-09 02:23:38 on dist-test-slave-w206"
server_key: "2fe578e428e65081f4080590486e5116"
server_key_iv: "fc7d327d98989255603e503206d85a6b"
server_key_version: "encryptionkey@0"
I20260809 02:23:38.027626 2372 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 02:23:38.028489 2387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:38.028658 2372 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:38.028779 2372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "3b9e276f64914e9e8fdac25f20a7844a"
format_stamp: "Formatted at 2026-08-09 02:23:38 on dist-test-slave-w206"
server_key: "2fe578e428e65081f4080590486e5116"
server_key_iv: "fc7d327d98989255603e503206d85a6b"
server_key_version: "encryptionkey@0"
I20260809 02:23:38.028856 2372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:38.032303 2372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:38.034174 2372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:38.034335 2372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:38.038205 2372 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:42671
I20260809 02:23:38.038236 2443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:42671 every 8 connection(s)
I20260809 02:23:38.038586 2372 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:38.039629 2444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:38.041936 2444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a: Bootstrap starting.
I20260809 02:23:38.042543 2444 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:38.042847 2444 log.cc:824] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:38.043668 2444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a: No bootstrap required, opened a new log
I20260809 02:23:38.044878 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 2372
I20260809 02:23:38.045004 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:38.045183 11638 external_mini_cluster.cc:1428] Setting key 05cf52ce02cc7aabde222fba62447b3c
I20260809 02:23:38.045537 2444 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b9e276f64914e9e8fdac25f20a7844a" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42671 } }
I20260809 02:23:38.045768 2444 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:38.045825 2444 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b9e276f64914e9e8fdac25f20a7844a, State: Initialized, Role: FOLLOWER
I20260809 02:23:38.046025 2444 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b9e276f64914e9e8fdac25f20a7844a" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42671 } }
I20260809 02:23:38.046113 2444 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:38.046144 2444 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:38.046183 2444 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:38.047045 2444 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b9e276f64914e9e8fdac25f20a7844a" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42671 } }
I20260809 02:23:38.047159 2444 leader_election.cc:302] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b9e276f64914e9e8fdac25f20a7844a; no voters:
I20260809 02:23:38.047369 2444 leader_election.cc:288] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:38.047402 2450 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:38.047572 2448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:38.045745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52235 (local address 127.11.93.190:42671)
0809 02:23:38.045938 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:38.045948 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:38.045980 (+ 32us) server_negotiation.cc:407] Connection header received
0809 02:23:38.046094 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:38.046102 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:38.046133 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:38.046275 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:38.046931 (+ 656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:38.046935 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:38.046935 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:38.046939 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:38.047007 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:38.047025 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:38.047106 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:38.047217 (+ 111us) server_negotiation.cc:299] Negotiation successful
0809 02:23:38.047263 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":87,"threads_started":1}
I20260809 02:23:38.047612 2450 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a [term 1 LEADER]: Becoming Leader. State: Replica: 3b9e276f64914e9e8fdac25f20a7844a, State: Running, Role: LEADER
I20260809 02:23:38.047626 2444 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:38.047863 2450 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b9e276f64914e9e8fdac25f20a7844a" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42671 } }
I20260809 02:23:38.048362 2452 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b9e276f64914e9e8fdac25f20a7844a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b9e276f64914e9e8fdac25f20a7844a" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42671 } } }
I20260809 02:23:38.048477 2452 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:38.048658 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:23:38.048837 2451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b9e276f64914e9e8fdac25f20a7844a. Latest consensus state: current_term: 1 leader_uuid: "3b9e276f64914e9e8fdac25f20a7844a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b9e276f64914e9e8fdac25f20a7844a" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 42671 } } }
I20260809 02:23:38.049067 2451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a [sys.catalog]: This master's current role is: LEADER
W20260809 02:23:38.049682 2466 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:23:38.049978 2466 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:23:38.050047 2459 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:38.050246 2459 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:38.051229 2448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:38.049973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44155 (local address 127.11.93.190:42671)
0809 02:23:38.050013 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:38.050015 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:38.050210 (+ 195us) server_negotiation.cc:407] Connection header received
0809 02:23:38.050259 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:38.050260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:38.050265 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:38.050324 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:38.050947 (+ 623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:38.050948 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:38.050949 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:38.050953 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:38.050966 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:38.050999 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:38.051030 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:38.051152 (+ 122us) server_negotiation.cc:299] Negotiation successful
0809 02:23:38.051168 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 02:23:38.052367 2459 catalog_manager.cc:1347] Generated new cluster ID: 8bfdfb2384b34a33bf01e5a04a73411a
I20260809 02:23:38.052424 2459 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:38.061194 2459 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:38.061427 2459 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:38.065383 2459 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b9e276f64914e9e8fdac25f20a7844a: Generated new TSK 0
I20260809 02:23:38.065619 2459 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:38.075121 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 2372
2026-08-09T02:23:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1336 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:38 dist-test-slave-w206 krb5kdc[2476](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:38 dist-test-slave-w206 krb5kdc[2476](info): set up 2 sockets
Aug 09 02:23:38 dist-test-slave-w206 krb5kdc[2476](info): commencing operation
krb5kdc: starting...
W20260809 02:23:39.142678 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.047s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:23:39 dist-test-slave-w206 krb5kdc[2476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:23:39.276299 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:46011
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:42559
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:46011
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:39.358124 2491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:39.358335 2491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:39.358357 2491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:39.359547 2491 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:39.359592 2491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:39.359607 2491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:39.359620 2491 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:39.359632 2491 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:39.361152 2491 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:42559
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:46011
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:46011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:39.361404 2491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:39.361655 2491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:23:39.366741 2491 server_base.cc:1034] running on GCE node
W20260809 02:23:39.366616 2496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:39.366631 2497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:39.366616 2499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:39.367204 2491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:39.367462 2491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:39.368603 2491 hybrid_clock.cc:648] HybridClock initialized: now 1786242219368589 us; error 37 us; skew 500 ppm
Aug 09 02:23:39 dist-test-slave-w206 krb5kdc[2476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242219, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:39.371181 2491 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:23:39.371644 2491 webserver.cc:460] Webserver started at http://127.11.93.190:40371/ using document root <none> and password file <none>
I20260809 02:23:39.371835 2491 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:39.371876 2491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:39.371966 2491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:39.373049 2491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "b1f88662e474472ea856d1078a11d007"
format_stamp: "Formatted at 2026-08-09 02:23:39 on dist-test-slave-w206"
server_key: "0fea875a98dbb019e0b080ecf62d3d80"
server_key_iv: "1686ea82acda820218eeb01607b6e3c0"
server_key_version: "encryptionkey@0"
I20260809 02:23:39.373386 2491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "b1f88662e474472ea856d1078a11d007"
format_stamp: "Formatted at 2026-08-09 02:23:39 on dist-test-slave-w206"
server_key: "0fea875a98dbb019e0b080ecf62d3d80"
server_key_iv: "1686ea82acda820218eeb01607b6e3c0"
server_key_version: "encryptionkey@0"
I20260809 02:23:39.374679 2491 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 02:23:39.375486 2506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:39.375655 2491 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:39.375761 2491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "b1f88662e474472ea856d1078a11d007"
format_stamp: "Formatted at 2026-08-09 02:23:39 on dist-test-slave-w206"
server_key: "0fea875a98dbb019e0b080ecf62d3d80"
server_key_iv: "1686ea82acda820218eeb01607b6e3c0"
server_key_version: "encryptionkey@0"
I20260809 02:23:39.375854 2491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:39.389997 2491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:39.392108 2491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:39.392271 2491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:39.396422 2491 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:46011
I20260809 02:23:39.396469 2559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:46011 every 8 connection(s)
I20260809 02:23:39.396849 2491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:39.397702 2560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:39.400183 2560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1f88662e474472ea856d1078a11d007: Bootstrap starting.
I20260809 02:23:39.400882 2560 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1f88662e474472ea856d1078a11d007: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:39.401249 2560 log.cc:824] T 00000000000000000000000000000000 P b1f88662e474472ea856d1078a11d007: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:39.401981 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 2491
I20260809 02:23:39.402098 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:39.402153 2560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1f88662e474472ea856d1078a11d007: No bootstrap required, opened a new log
I20260809 02:23:39.402289 11638 external_mini_cluster.cc:1428] Setting key 25c0ad70b2f19a33ca9aaac6dc0717aa
I20260809 02:23:39.405295 2560 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1f88662e474472ea856d1078a11d007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f88662e474472ea856d1078a11d007" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46011 } }
I20260809 02:23:39.405493 2560 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1f88662e474472ea856d1078a11d007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:39.405540 2560 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1f88662e474472ea856d1078a11d007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f88662e474472ea856d1078a11d007, State: Initialized, Role: FOLLOWER
I20260809 02:23:39.405694 2560 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1f88662e474472ea856d1078a11d007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f88662e474472ea856d1078a11d007" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46011 } }
I20260809 02:23:39.405781 2560 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1f88662e474472ea856d1078a11d007 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:39.405829 2560 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1f88662e474472ea856d1078a11d007 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:39.405879 2560 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1f88662e474472ea856d1078a11d007 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:39.406464 2560 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1f88662e474472ea856d1078a11d007 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f88662e474472ea856d1078a11d007" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46011 } }
I20260809 02:23:39.406592 2560 leader_election.cc:302] T 00000000000000000000000000000000 P b1f88662e474472ea856d1078a11d007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1f88662e474472ea856d1078a11d007; no voters:
I20260809 02:23:39.406764 2560 leader_election.cc:288] T 00000000000000000000000000000000 P b1f88662e474472ea856d1078a11d007 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:39.406801 2565 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1f88662e474472ea856d1078a11d007 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:39.407035 2565 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1f88662e474472ea856d1078a11d007 [term 1 LEADER]: Becoming Leader. State: Replica: b1f88662e474472ea856d1078a11d007, State: Running, Role: LEADER
I20260809 02:23:39.407069 2560 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1f88662e474472ea856d1078a11d007 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:39.407186 2565 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1f88662e474472ea856d1078a11d007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f88662e474472ea856d1078a11d007" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46011 } }
I20260809 02:23:39.407569 2565 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1f88662e474472ea856d1078a11d007 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1f88662e474472ea856d1078a11d007" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f88662e474472ea856d1078a11d007" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46011 } } }
I20260809 02:23:39.407684 2565 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1f88662e474472ea856d1078a11d007 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:39.407871 2565 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1f88662e474472ea856d1078a11d007 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1f88662e474472ea856d1078a11d007. Latest consensus state: current_term: 1 leader_uuid: "b1f88662e474472ea856d1078a11d007" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f88662e474472ea856d1078a11d007" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 46011 } } }
I20260809 02:23:39.407987 2565 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1f88662e474472ea856d1078a11d007 [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:39.408160 2574 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:39.408674 2574 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:39.410710 2574 catalog_manager.cc:1347] Generated new cluster ID: a979d1b18b8e437abd787541b458d88c
I20260809 02:23:39.410766 2574 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 02:23:39 dist-test-slave-w206 krb5kdc[2476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:23:39.419319 2564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:39.402771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33855 (local address 127.11.93.190:46011)
0809 02:23:39.402998 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:39.403008 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:39.403046 (+ 38us) server_negotiation.cc:407] Connection header received
0809 02:23:39.405226 (+ 2180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:39.405234 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:39.405283 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:39.405453 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:39.406221 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:39.407725 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:39.408924 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:39.409511 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:39.410099 (+ 588us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:39.413481 (+ 3382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:39.413485 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:39.413485 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:39.413499 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:39.416736 (+ 3237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:39.417259 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:39.417263 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:39.417264 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:39.417407 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:39.417694 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:39.417694 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:39.417695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:39.418057 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:39.418715 (+ 658us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:39.418812 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 02:23:39.419054 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":88,"threads_started":1}
I20260809 02:23:39.419600 2574 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:39.420352 2574 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:39.420522 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:23:39.425750 2574 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1f88662e474472ea856d1078a11d007: Generated new TSK 0
I20260809 02:23:39.425925 2574 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:39.433265 2564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:39.422194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35607 (local address 127.11.93.190:46011)
0809 02:23:39.422231 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:39.422232 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:39.427187 (+ 4955us) server_negotiation.cc:407] Connection header received
0809 02:23:39.427266 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:39.427267 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:39.427277 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:39.427329 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:39.427867 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:39.428379 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:39.429117 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:39.429345 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:39.429422 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:39.430652 (+ 1230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:39.430654 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:39.430654 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:39.430661 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:39.432086 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:39.432457 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:39.432458 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:39.432458 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:39.432517 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:39.432725 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:39.432726 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:39.432727 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:39.432847 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:39.432966 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:39.433071 (+ 105us) server_negotiation.cc:299] Negotiation successful
0809 02:23:39.433151 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 02:23:39.435079 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 2491
2026-08-09T02:23:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1359 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:39 dist-test-slave-w206 krb5kdc[2594](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:39 dist-test-slave-w206 krb5kdc[2594](info): set up 2 sockets
Aug 09 02:23:39 dist-test-slave-w206 krb5kdc[2594](info): commencing operation
krb5kdc: starting...
W20260809 02:23:40.510780 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:23:40 dist-test-slave-w206 krb5kdc[2594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242220, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:23:40.637625 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:37285
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:35929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:37285
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:40.719660 2609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:40.719856 2609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:40.719877 2609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:40.721226 2609 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:40.721279 2609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:40.721294 2609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:40.721307 2609 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:40.721319 2609 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:40.722816 2609 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:35929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:37285
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:37285
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2609
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:40.723097 2609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:40.723286 2609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:40.728189 2614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:40.728332 2617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:40.728332 2615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:40.728511 2609 server_base.cc:1034] running on GCE node
I20260809 02:23:40.728766 2609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:40.729068 2609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:40.730213 2609 hybrid_clock.cc:648] HybridClock initialized: now 1786242220730192 us; error 45 us; skew 500 ppm
Aug 09 02:23:40 dist-test-slave-w206 krb5kdc[2594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242220, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:40.732935 2609 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:23:40.733371 2609 webserver.cc:460] Webserver started at http://127.11.93.190:41723/ using document root <none> and password file <none>
I20260809 02:23:40.733594 2609 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:40.733639 2609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:40.733803 2609 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:40.734902 2609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "3e4aed0363fa44f2bee3eed9993476ec"
format_stamp: "Formatted at 2026-08-09 02:23:40 on dist-test-slave-w206"
server_key: "3abfa6b27841429e4658003628691272"
server_key_iv: "0d1198519b23ea6b8f78400f03d8f733"
server_key_version: "encryptionkey@0"
I20260809 02:23:40.735363 2609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "3e4aed0363fa44f2bee3eed9993476ec"
format_stamp: "Formatted at 2026-08-09 02:23:40 on dist-test-slave-w206"
server_key: "3abfa6b27841429e4658003628691272"
server_key_iv: "0d1198519b23ea6b8f78400f03d8f733"
server_key_version: "encryptionkey@0"
I20260809 02:23:40.736697 2609 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:40.737409 2625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:40.737596 2609 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:23:40.737700 2609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "3e4aed0363fa44f2bee3eed9993476ec"
format_stamp: "Formatted at 2026-08-09 02:23:40 on dist-test-slave-w206"
server_key: "3abfa6b27841429e4658003628691272"
server_key_iv: "0d1198519b23ea6b8f78400f03d8f733"
server_key_version: "encryptionkey@0"
I20260809 02:23:40.737787 2609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:40.752048 2609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:40.754383 2609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:40.754549 2609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:40.758404 2609 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:37285
I20260809 02:23:40.758471 2677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:37285 every 8 connection(s)
I20260809 02:23:40.758813 2609 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:40.759723 2678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:40.761906 2678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e4aed0363fa44f2bee3eed9993476ec: Bootstrap starting.
I20260809 02:23:40.762519 2678 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e4aed0363fa44f2bee3eed9993476ec: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:40.762506 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 2609
I20260809 02:23:40.762617 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:40.762846 11638 external_mini_cluster.cc:1428] Setting key 10958c98526b68b46c722a1c02433858
I20260809 02:23:40.762856 2678 log.cc:824] T 00000000000000000000000000000000 P 3e4aed0363fa44f2bee3eed9993476ec: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:40.763634 2678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e4aed0363fa44f2bee3eed9993476ec: No bootstrap required, opened a new log
I20260809 02:23:40.765712 2678 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e4aed0363fa44f2bee3eed9993476ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e4aed0363fa44f2bee3eed9993476ec" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 37285 } }
I20260809 02:23:40.765883 2678 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3e4aed0363fa44f2bee3eed9993476ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:40.765933 2678 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e4aed0363fa44f2bee3eed9993476ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e4aed0363fa44f2bee3eed9993476ec, State: Initialized, Role: FOLLOWER
I20260809 02:23:40.766099 2678 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e4aed0363fa44f2bee3eed9993476ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e4aed0363fa44f2bee3eed9993476ec" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 37285 } }
I20260809 02:23:40.766194 2678 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3e4aed0363fa44f2bee3eed9993476ec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:40.766237 2678 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3e4aed0363fa44f2bee3eed9993476ec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:40.766284 2678 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e4aed0363fa44f2bee3eed9993476ec [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:40.766822 2678 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3e4aed0363fa44f2bee3eed9993476ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e4aed0363fa44f2bee3eed9993476ec" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 37285 } }
I20260809 02:23:40.766963 2678 leader_election.cc:302] T 00000000000000000000000000000000 P 3e4aed0363fa44f2bee3eed9993476ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e4aed0363fa44f2bee3eed9993476ec; no voters:
I20260809 02:23:40.767151 2678 leader_election.cc:288] T 00000000000000000000000000000000 P 3e4aed0363fa44f2bee3eed9993476ec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:40.767184 2683 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3e4aed0363fa44f2bee3eed9993476ec [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:40.767406 2678 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e4aed0363fa44f2bee3eed9993476ec [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:40.767669 2683 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3e4aed0363fa44f2bee3eed9993476ec [term 1 LEADER]: Becoming Leader. State: Replica: 3e4aed0363fa44f2bee3eed9993476ec, State: Running, Role: LEADER
I20260809 02:23:40.767823 2683 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3e4aed0363fa44f2bee3eed9993476ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e4aed0363fa44f2bee3eed9993476ec" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 37285 } }
I20260809 02:23:40.768186 2684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e4aed0363fa44f2bee3eed9993476ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3e4aed0363fa44f2bee3eed9993476ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e4aed0363fa44f2bee3eed9993476ec" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 37285 } } }
I20260809 02:23:40.768282 2684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e4aed0363fa44f2bee3eed9993476ec [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:40.768445 2684 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e4aed0363fa44f2bee3eed9993476ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e4aed0363fa44f2bee3eed9993476ec. Latest consensus state: current_term: 1 leader_uuid: "3e4aed0363fa44f2bee3eed9993476ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e4aed0363fa44f2bee3eed9993476ec" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 37285 } } }
I20260809 02:23:40.768455 2682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:40.763407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54279 (local address 127.11.93.190:37285)
0809 02:23:40.763598 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:40.763606 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:40.763643 (+ 37us) server_negotiation.cc:407] Connection header received
0809 02:23:40.764114 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:40.764120 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:40.764167 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:40.764353 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:40.764583 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:40.765477 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:40.766429 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:40.766853 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:40.766976 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:40.767687 (+ 711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:40.767691 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:40.767692 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:40.767922 (+ 230us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:40.767960 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:40.767975 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:40.768016 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:40.768154 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 02:23:40.768236 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":75,"threads_started":1}
I20260809 02:23:40.768507 2684 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e4aed0363fa44f2bee3eed9993476ec [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:40.768512 2692 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:40.769035 2692 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:40.769469 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:23:40.771474 2701 mvcc.cc:205] Tried to move back new op lower bound from 7316448136274497536 to 7316448136265445376. Current Snapshot: MvccSnapshot[applied={T|T < 7316448136274497536}]
I20260809 02:23:40.772063 2692 catalog_manager.cc:1347] Generated new cluster ID: 240b66db2de14df59e7467f8c8f52627
I20260809 02:23:40.772117 2692 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:40.774923 2682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:40.770975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55985 (local address 127.11.93.190:37285)
0809 02:23:40.771026 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:40.771028 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:40.771601 (+ 573us) server_negotiation.cc:407] Connection header received
0809 02:23:40.771675 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:40.771676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:40.771686 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:40.771716 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:40.771916 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:40.772656 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:40.773621 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:40.773928 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:40.774003 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:40.774680 (+ 677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:40.774681 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:40.774681 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:40.774686 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:40.774702 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:40.774706 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:40.774767 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:40.774824 (+ 57us) server_negotiation.cc:299] Negotiation successful
0809 02:23:40.774847 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 02:23:40.789088 2692 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:40.789825 2692 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:40.796808 2692 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3e4aed0363fa44f2bee3eed9993476ec: Generated new TSK 0
I20260809 02:23:40.796999 2692 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:40.807685 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 2609
2026-08-09T02:23:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1372 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:40 dist-test-slave-w206 krb5kdc[2710](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:40 dist-test-slave-w206 krb5kdc[2710](info): set up 2 sockets
Aug 09 02:23:40 dist-test-slave-w206 krb5kdc[2710](info): commencing operation
krb5kdc: starting...
W20260809 02:23:41.874197 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:23:41 dist-test-slave-w206 krb5kdc[2710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242221, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:23:42.001964 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:32953
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:46439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:32953
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:42.084936 2724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:42.085144 2724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:42.085170 2724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:42.086338 2724 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:42.086382 2724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:42.086402 2724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:42.086416 2724 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:42.086473 2724 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:42.087967 2724 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:46439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:32953
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:32953
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2724
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:42.088236 2724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:42.088492 2724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:42.093386 2732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:42.093482 2734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:42.093423 2731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:42.093667 2724 server_base.cc:1034] running on GCE node
I20260809 02:23:42.093917 2724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:42.094204 2724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:42.095359 2724 hybrid_clock.cc:648] HybridClock initialized: now 1786242222095339 us; error 34 us; skew 500 ppm
Aug 09 02:23:42 dist-test-slave-w206 krb5kdc[2710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242222, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:42.102447 2724 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:23:42.103012 2724 webserver.cc:460] Webserver started at http://127.11.93.190:40889/ using document root <none> and password file <none>
I20260809 02:23:42.103268 2724 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:42.103344 2724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:42.103505 2724 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:42.104583 2724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "bef68debbb034d5c8ae81547fd26f95d"
format_stamp: "Formatted at 2026-08-09 02:23:42 on dist-test-slave-w206"
server_key: "be69087c7bcdf080e9291e6fba7e8ccd"
server_key_iv: "08cac33f2f034c274af1c7435e668013"
server_key_version: "encryptionkey@0"
I20260809 02:23:42.104956 2724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "bef68debbb034d5c8ae81547fd26f95d"
format_stamp: "Formatted at 2026-08-09 02:23:42 on dist-test-slave-w206"
server_key: "be69087c7bcdf080e9291e6fba7e8ccd"
server_key_iv: "08cac33f2f034c274af1c7435e668013"
server_key_version: "encryptionkey@0"
I20260809 02:23:42.106336 2724 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:23:42.107102 2741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:42.107280 2724 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:42.107409 2724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "bef68debbb034d5c8ae81547fd26f95d"
format_stamp: "Formatted at 2026-08-09 02:23:42 on dist-test-slave-w206"
server_key: "be69087c7bcdf080e9291e6fba7e8ccd"
server_key_iv: "08cac33f2f034c274af1c7435e668013"
server_key_version: "encryptionkey@0"
I20260809 02:23:42.107493 2724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:42.110868 2724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:42.112819 2724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:42.112978 2724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:42.117057 2724 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:32953
I20260809 02:23:42.117092 2798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:32953 every 8 connection(s)
I20260809 02:23:42.117429 2724 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:42.117887 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 2724
I20260809 02:23:42.118000 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:42.118184 11638 external_mini_cluster.cc:1428] Setting key 9443225651e7daaac30334459054a6e7
I20260809 02:23:42.118578 2799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:42.120743 2802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:42.118705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56315 (local address 127.11.93.190:32953)
0809 02:23:42.118905 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:42.118914 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:42.118945 (+ 31us) server_negotiation.cc:407] Connection header received
0809 02:23:42.119477 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:42.119485 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:42.119517 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:42.119667 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:42.120304 (+ 637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:42.120308 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:42.120308 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:42.120314 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:42.120356 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:42.120371 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:42.120445 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:42.120499 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 02:23:42.120538 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":96,"threads_started":1}
I20260809 02:23:42.121866 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:23:42.122104 2799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d: Bootstrap starting.
I20260809 02:23:42.122696 2799 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:42.123066 2799 log.cc:824] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:42.123955 2799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d: No bootstrap required, opened a new log
I20260809 02:23:42.124521 2802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:42.123409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44755 (local address 127.11.93.190:32953)
0809 02:23:42.123448 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:42.123450 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:42.123560 (+ 110us) server_negotiation.cc:407] Connection header received
0809 02:23:42.123631 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:42.123631 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:42.123636 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:42.123689 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:42.124294 (+ 605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:42.124295 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:42.124296 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:23:42.124300 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:42.124313 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:23:42.124317 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:42.124382 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:42.124441 (+ 59us) server_negotiation.cc:299] Negotiation successful
0809 02:23:42.124455 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 02:23:42.125954 2799 raft_consensus.cc:348] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef68debbb034d5c8ae81547fd26f95d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 32953 } }
I20260809 02:23:42.126084 2799 raft_consensus.cc:374] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:23:42.126106 2799 raft_consensus.cc:729] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bef68debbb034d5c8ae81547fd26f95d, State: Initialized, Role: FOLLOWER
I20260809 02:23:42.126281 2799 consensus_queue.cc:260] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef68debbb034d5c8ae81547fd26f95d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 32953 } }
I20260809 02:23:42.126412 2809 raft_consensus.cc:482] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:23:42.126478 2809 raft_consensus.cc:504] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef68debbb034d5c8ae81547fd26f95d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 32953 } }
I20260809 02:23:42.126391 2799 raft_consensus.cc:388] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:23:42.126573 2809 leader_election.cc:302] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bef68debbb034d5c8ae81547fd26f95d; no voters:
I20260809 02:23:42.126602 2799 raft_consensus.cc:482] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:23:42.126631 2799 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:42.126732 2809 leader_election.cc:288] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers
I20260809 02:23:42.127265 2799 raft_consensus.cc:504] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef68debbb034d5c8ae81547fd26f95d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 32953 } }
I20260809 02:23:42.127379 2799 leader_election.cc:302] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bef68debbb034d5c8ae81547fd26f95d; no voters:
I20260809 02:23:42.127477 2799 leader_election.cc:288] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:23:42.127400 2810 raft_consensus.cc:2741] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260809 02:23:42.127671 2809 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:42.127733 2809 raft_consensus.cc:686] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d [term 1 LEADER]: Becoming Leader. State: Replica: bef68debbb034d5c8ae81547fd26f95d, State: Running, Role: LEADER
I20260809 02:23:42.127751 2799 sys_catalog.cc:564] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:42.127811 2809 consensus_queue.cc:237] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef68debbb034d5c8ae81547fd26f95d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 32953 } }
I20260809 02:23:42.128216 2810 sys_catalog.cc:455] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d [sys.catalog]: SysCatalogTable state changed. Reason: New leader bef68debbb034d5c8ae81547fd26f95d. Latest consensus state: current_term: 1 leader_uuid: "bef68debbb034d5c8ae81547fd26f95d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef68debbb034d5c8ae81547fd26f95d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 32953 } } }
I20260809 02:23:42.128217 2811 sys_catalog.cc:455] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bef68debbb034d5c8ae81547fd26f95d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef68debbb034d5c8ae81547fd26f95d" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 32953 } } }
I20260809 02:23:42.128352 2810 sys_catalog.cc:458] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:42.128360 2811 sys_catalog.cc:458] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:42.129302 2817 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:42.129769 2817 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:42.131389 2817 catalog_manager.cc:1347] Generated new cluster ID: 687bcef583e74b9cbb3a84a46537e65a
I20260809 02:23:42.131441 2817 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:42.147002 2817 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:42.147226 2817 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:42.151074 2817 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bef68debbb034d5c8ae81547fd26f95d: Generated new TSK 0
I20260809 02:23:42.151309 2817 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:42.168933 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 2724
2026-08-09T02:23:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1360 ms)
[----------] 18 tests from AuthTokenIssuingTest (24813 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:42 dist-test-slave-w206 krb5kdc[2830](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:42 dist-test-slave-w206 krb5kdc[2830](info): set up 2 sockets
Aug 09 02:23:42 dist-test-slave-w206 krb5kdc[2830](info): commencing operation
krb5kdc: starting...
W20260809 02:23:43.253818 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.065s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:23:43 dist-test-slave-w206 krb5kdc[2830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242223, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:23:43.379470 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:38463
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:37257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:38463,127.11.93.189:40587,127.11.93.188:44339
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:43.462940 2844 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 02:23:43.463223 2844 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:43.463254 2844 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:43.463294 2844 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:43.464464 2844 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:43.464535 2844 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:43.464560 2844 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:43.464581 2844 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:43.464610 2844 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:43.466106 2844 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:37257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:38463,127.11.93.189:40587,127.11.93.188:44339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:38463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2844
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:43.466398 2844 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:43.466627 2844 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:43.471562 2853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:43.471673 2844 server_base.cc:1034] running on GCE node
W20260809 02:23:43.471503 2850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:43.471537 2851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:43.472020 2844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:43.472338 2844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:43.473516 2844 hybrid_clock.cc:648] HybridClock initialized: now 1786242223473486 us; error 64 us; skew 500 ppm
Aug 09 02:23:43 dist-test-slave-w206 krb5kdc[2830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242223, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:43.476225 2844 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:23:43.476608 2844 webserver.cc:460] Webserver started at http://127.11.93.190:46753/ using document root <none> and password file <none>
I20260809 02:23:43.476785 2844 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:43.476824 2844 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:43.476945 2844 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:43.477959 2844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "aa082c9b3ee849ebac299db65fab07da"
format_stamp: "Formatted at 2026-08-09 02:23:43 on dist-test-slave-w206"
server_key: "fc974cb1114083193fe7bb9f038670a6"
server_key_iv: "550a9e7af8ee683a4b37669a93b2f75b"
server_key_version: "encryptionkey@0"
I20260809 02:23:43.478262 2844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "aa082c9b3ee849ebac299db65fab07da"
format_stamp: "Formatted at 2026-08-09 02:23:43 on dist-test-slave-w206"
server_key: "fc974cb1114083193fe7bb9f038670a6"
server_key_iv: "550a9e7af8ee683a4b37669a93b2f75b"
server_key_version: "encryptionkey@0"
I20260809 02:23:43.479606 2844 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 02:23:43.480322 2860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:43.480492 2844 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:23:43.480602 2844 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "aa082c9b3ee849ebac299db65fab07da"
format_stamp: "Formatted at 2026-08-09 02:23:43 on dist-test-slave-w206"
server_key: "fc974cb1114083193fe7bb9f038670a6"
server_key_iv: "550a9e7af8ee683a4b37669a93b2f75b"
server_key_version: "encryptionkey@0"
I20260809 02:23:43.480679 2844 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:43.505595 2844 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:43.508087 2844 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:43.508263 2844 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:43.512419 2844 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:38463
I20260809 02:23:43.512454 2915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:38463 every 8 connection(s)
I20260809 02:23:43.512810 2844 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:43.513819 2916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:43.515219 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 2844
I20260809 02:23:43.515323 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:43.515502 11638 external_mini_cluster.cc:1428] Setting key d6bd669b3b6aa93315cd91b529ac5a8c
I20260809 02:23:43.515954 2916 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38463 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:23:43 dist-test-slave-w206 krb5kdc[2830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242223, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.93.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.189@KRBTEST.COM" created.
I20260809 02:23:43.527587 2920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.517026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41694 (local address 127.11.93.190:38463)
0809 02:23:43.517179 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:43.517182 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:43.517251 (+ 69us) server_negotiation.cc:407] Connection header received
0809 02:23:43.518027 (+ 776us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:43.518029 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:43.518054 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:43.518165 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:43.518745 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.519819 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.521249 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.521583 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.521673 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.524127 (+ 2454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:43.524134 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:43.524135 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:43.524141 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:43.525825 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.526181 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.526184 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.526185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.526261 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.526517 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.526523 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.526523 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.526832 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:43.526918 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:43.527196 (+ 278us) server_negotiation.cc:299] Negotiation successful
0809 02:23:43.527406 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":89,"server-negotiator.queue_time_us":116,"thread_start_us":78,"threads_started":1}
I20260809 02:23:43.527599 2919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.516851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:38463 (local address 127.0.0.1:41694)
0809 02:23:43.517033 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.517081 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:43.517753 (+ 672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:43.518181 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:43.518184 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:43.518455 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:43.518611 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:43.518615 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.519933 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.519935 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:43.521149 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:43.521152 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.521712 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.521713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:43.521804 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.522365 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:43.522375 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:43.524019 (+ 1644us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:43.525898 (+ 1879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:43.525905 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:43.525906 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:43.526104 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:43.526322 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:43.526322 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:43.526322 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:43.526416 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:43.526917 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:43.526923 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:43.527034 (+ 111us) client_negotiation.cc:769] Sending connection context
0809 02:23:43.527121 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 02:23:43.527296 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":87,"threads_started":1}
I20260809 02:23:43.528630 2916 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:23:43.529021 2919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.528909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:40587 (local address 127.0.0.1:37974)
0809 02:23:43.528958 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.529002 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.189:40587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260809 02:23:43.529150 2861 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.93.189:40587: connect: Connection refused (error 111)
I20260809 02:23:43.529663 2919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.529568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:40587 (local address 127.0.0.1:37986)
0809 02:23:43.529615 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.529639 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.189:40587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 02:23:43.529779 2916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.189:40587: Network error: Client connection negotiation failed: client connection to 127.11.93.189:40587: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.189.keytab.
Entry for principal kudu/127.11.93.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.189.keytab.
I20260809 02:23:43.544004 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.189:40587
--webserver_interface=127.11.93.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.189.keytab
--principal=kudu/127.11.93.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:37257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:38463,127.11.93.189:40587,127.11.93.188:44339
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:23:43.579043 2916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } attempt: 1
I20260809 02:23:43.579598 2919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.579439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:40587 (local address 127.0.0.1:38000)
0809 02:23:43.579512 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.579562 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.189:40587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 02:23:43.580024 2919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.579916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:40587 (local address 127.0.0.1:38016)
0809 02:23:43.579965 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.579994 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.189:40587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 02:23:43.580163 2916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.189:40587: Network error: Client connection negotiation failed: client connection to 127.11.93.189:40587: connect: Connection refused (error 111)
W20260809 02:23:43.626662 2924 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 02:23:43.626880 2924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:43.626897 2924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:43.626919 2924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:43.628127 2924 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:43.628172 2924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:43.628187 2924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:43.628233 2924 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:43.628260 2924 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:43.629734 2924 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:37257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:38463,127.11.93.189:40587,127.11.93.188:44339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.189.keytab
--principal=kudu/127.11.93.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.189:40587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.93.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2924
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:43.629992 2924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:43.630234 2924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:43.635234 2929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:43.635269 2930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:43.635473 2924 server_base.cc:1034] running on GCE node
W20260809 02:23:43.635279 2932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:43.635764 2924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:43.636053 2924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:43.637286 2924 hybrid_clock.cc:648] HybridClock initialized: now 1786242223637277 us; error 46 us; skew 500 ppm
Aug 09 02:23:43 dist-test-slave-w206 krb5kdc[2830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242223, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:43.640152 2924 init.cc:377] Logged in from keytab as kudu/127.11.93.189@KRBTEST.COM (short username kudu)
I20260809 02:23:43.640635 2924 webserver.cc:460] Webserver started at http://127.11.93.189:37195/ using document root <none> and password file <none>
I20260809 02:23:43.640882 2924 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:43.640954 2924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:43.641099 2924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:43.642139 2924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-1/data/instance:
uuid: "0ca90f4388d94283a343df448c1f737a"
format_stamp: "Formatted at 2026-08-09 02:23:43 on dist-test-slave-w206"
server_key: "565ef429597f454fe9e97433be72a2b8"
server_key_iv: "da6964a49b3b695a010f8bb31bf0ed52"
server_key_version: "encryptionkey@0"
I20260809 02:23:43.642508 2924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-1/wal/instance:
uuid: "0ca90f4388d94283a343df448c1f737a"
format_stamp: "Formatted at 2026-08-09 02:23:43 on dist-test-slave-w206"
server_key: "565ef429597f454fe9e97433be72a2b8"
server_key_iv: "da6964a49b3b695a010f8bb31bf0ed52"
server_key_version: "encryptionkey@0"
I20260809 02:23:43.643910 2924 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:23:43.644718 2939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:43.644909 2924 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:23:43.645017 2924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-1/wal
uuid: "0ca90f4388d94283a343df448c1f737a"
format_stamp: "Formatted at 2026-08-09 02:23:43 on dist-test-slave-w206"
server_key: "565ef429597f454fe9e97433be72a2b8"
server_key_iv: "da6964a49b3b695a010f8bb31bf0ed52"
server_key_version: "encryptionkey@0"
I20260809 02:23:43.645090 2924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:43.648362 2916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } attempt: 2
I20260809 02:23:43.648801 2919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.648662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:40587 (local address 127.0.0.1:38032)
0809 02:23:43.648720 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.648760 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.189:40587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 02:23:43.649206 2919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.649066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:40587 (local address 127.0.0.1:38044)
0809 02:23:43.649142 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.649177 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.189:40587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260809 02:23:43.649343 2916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.189:40587: Network error: Client connection negotiation failed: client connection to 127.11.93.189:40587: connect: Connection refused (error 111)
I20260809 02:23:43.652460 2924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:43.654215 2924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:43.654379 2924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:43.658485 2924 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.189:40587
I20260809 02:23:43.658532 2994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.189:40587 every 8 connection(s)
I20260809 02:23:43.658885 2924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-1/data/info.pb
I20260809 02:23:43.659446 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 2924
I20260809 02:23:43.659584 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-1/wal/instance
I20260809 02:23:43.659844 11638 external_mini_cluster.cc:1428] Setting key 7c74de0373556f65c3c35e1994588892
I20260809 02:23:43.660171 2995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:43.662338 2995 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38463 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.93.188@KRBTEST.COM; defaulting to no policy
Aug 09 02:23:43 dist-test-slave-w206 krb5kdc[2830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242223, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.189@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.188@KRBTEST.COM" created.
I20260809 02:23:43.672322 2920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.663115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41698 (local address 127.11.93.190:38463)
0809 02:23:43.663180 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:43.663182 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:43.663411 (+ 229us) server_negotiation.cc:407] Connection header received
0809 02:23:43.663853 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:43.663854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:43.663872 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:43.663951 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:43.664659 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.665487 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.666446 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.666777 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.666869 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.669044 (+ 2175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:43.669045 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:43.669045 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:43.669052 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:43.670649 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.671247 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.671248 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.671248 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.671317 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.671655 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.671655 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.671655 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.671760 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:43.671825 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:43.672183 (+ 358us) server_negotiation.cc:299] Negotiation successful
0809 02:23:43.672251 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:23:43.672722 2998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.663107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:38463 (local address 127.0.0.1:41698)
0809 02:23:43.663263 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.663300 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:43.663754 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:43.664022 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:43.664026 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:43.664360 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:43.664554 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:43.664558 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.665592 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.665593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:43.666360 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:43.666362 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.666897 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.666898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:43.667042 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.667587 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:43.667595 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:43.668954 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:43.670742 (+ 1788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:43.670750 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:43.670752 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:43.671157 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:43.671400 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:43.671401 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:43.671402 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:43.671579 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:43.671830 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:43.671837 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:43.672030 (+ 193us) client_negotiation.cc:769] Sending connection context
0809 02:23:43.672151 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 02:23:43.672408 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":88,"threads_started":1}
I20260809 02:23:43.673370 2995 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:23:43 dist-test-slave-w206 krb5kdc[2830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242223, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.189@KRBTEST.COM for kudu/127.11.93.189@KRBTEST.COM
I20260809 02:23:43.681870 2998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.673650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:40587 (local address 127.0.0.1:38046)
0809 02:23:43.673699 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.673710 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:43.673752 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:43.674029 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:43.674030 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:43.674202 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:43.674259 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:43.674261 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.675302 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.675304 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:43.676175 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:43.676178 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.676922 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.676923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:43.676978 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.677453 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:43.677457 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:43.678857 (+ 1400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:43.680906 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:43.680907 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:43.680907 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:43.681066 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:43.681258 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:43.681259 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:43.681259 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:43.681311 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:43.681618 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:43.681619 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:43.681658 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 02:23:43.681715 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 02:23:43.681803 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 02:23:43.681973 3000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.673736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38046 (local address 127.11.93.189:40587)
0809 02:23:43.673890 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:43.673894 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:43.673914 (+ 20us) server_negotiation.cc:407] Connection header received
0809 02:23:43.673931 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:43.673932 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:43.673942 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:43.674028 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:43.674352 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.675214 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.676275 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.676800 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.676904 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.678950 (+ 2046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:43.678960 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:43.678961 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:43.678968 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:43.680811 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.681143 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.681146 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.681146 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.681200 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.681404 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.681405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.681405 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.681555 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:43.681618 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:43.681765 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 02:23:43.681862 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":129,"thread_start_us":103,"threads_started":1}
I20260809 02:23:43.682597 2995 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:23:43.683046 2998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.682887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:44339 (local address 127.0.0.1:58410)
0809 02:23:43.682944 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.683021 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:44339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260809 02:23:43.683198 2940 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.93.188:44339: connect: Connection refused (error 111)
I20260809 02:23:43.683699 2998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.683613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:44339 (local address 127.0.0.1:58422)
0809 02:23:43.683658 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.683683 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:44339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 02:23:43.683799 2995 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.188:44339: Network error: Client connection negotiation failed: client connection to 127.11.93.188:44339: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.188.keytab.
Entry for principal kudu/127.11.93.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.188.keytab.
I20260809 02:23:43.689924 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.188:44339
--webserver_interface=127.11.93.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.188.keytab
--principal=kudu/127.11.93.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:37257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:38463,127.11.93.189:40587,127.11.93.188:44339
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:23:43.732995 2995 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } attempt: 1
I20260809 02:23:43.733500 2998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.733360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:44339 (local address 127.0.0.1:58428)
0809 02:23:43.733425 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.733466 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:44339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 02:23:43.733865 2998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.733757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:44339 (local address 127.0.0.1:58430)
0809 02:23:43.733805 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.733829 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:44339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 02:23:43.733964 2995 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.188:44339: Network error: Client connection negotiation failed: client connection to 127.11.93.188:44339: connect: Connection refused (error 111)
I20260809 02:23:43.740489 2916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } attempt: 3
Aug 09 02:23:43 dist-test-slave-w206 krb5kdc[2830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242223, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for kudu/127.11.93.189@KRBTEST.COM
I20260809 02:23:43.748006 3000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.740964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38060 (local address 127.11.93.189:40587)
0809 02:23:43.741032 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:43.741034 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:43.741045 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:23:43.741072 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:43.741073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:43.741092 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:43.741157 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:43.741498 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.741996 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.742810 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.743111 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.743190 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.745366 (+ 2176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:43.745368 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:43.745368 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:43.745377 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:43.746740 (+ 1363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.747177 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.747178 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.747179 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.747242 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.747447 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.747448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.747449 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.747568 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:43.747669 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:43.747822 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 02:23:43.747905 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:23:43.748006 2919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.740849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:40587 (local address 127.0.0.1:38060)
0809 02:23:43.740923 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.740933 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:43.740977 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:43.741164 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:43.741165 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:43.741343 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:43.741409 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:43.741411 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.742092 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.742093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:43.742643 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:43.742645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.743200 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.743202 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:43.743286 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.743788 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:43.743793 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:43.745272 (+ 1479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:43.746829 (+ 1557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:43.746844 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:43.746845 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:43.747083 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:43.747310 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:43.747311 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:43.747311 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:43.747373 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:43.747658 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:43.747659 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:43.747707 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 02:23:43.747797 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 02:23:43.747905 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 02:23:43.748543 2916 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:23:43.748916 2919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.748828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:44339 (local address 127.0.0.1:58444)
0809 02:23:43.748869 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.748897 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:44339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260809 02:23:43.749218 2919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.749129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:44339 (local address 127.0.0.1:58460)
0809 02:23:43.749174 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.749197 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:44339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260809 02:23:43.749310 2916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.188:44339: Network error: Client connection negotiation failed: client connection to 127.11.93.188:44339: connect: Connection refused (error 111)
W20260809 02:23:43.774134 3002 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 02:23:43.774363 3002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:43.774410 3002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:43.774448 3002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:43.775583 3002 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:43.775646 3002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:43.775671 3002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:43.775692 3002 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:43.775719 3002 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:43.777166 3002 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:37257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:38463,127.11.93.189:40587,127.11.93.188:44339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.188.keytab
--principal=kudu/127.11.93.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.188:44339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.93.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3002
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:43.777436 3002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:43.777647 3002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:23:43.780449 2916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } attempt: 1
I20260809 02:23:43.780866 2919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.780737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:44339 (local address 127.0.0.1:58462)
0809 02:23:43.780801 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.780839 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:44339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 02:23:43.781203 2919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.781106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:44339 (local address 127.0.0.1:58470)
0809 02:23:43.781150 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.781175 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:44339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260809 02:23:43.781379 2916 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.188:44339: Network error: Client connection negotiation failed: client connection to 127.11.93.188:44339: connect: Connection refused (error 111)
W20260809 02:23:43.782498 3007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:43.782682 3002 server_base.cc:1034] running on GCE node
W20260809 02:23:43.782511 3010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:43.782517 3008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:43.783089 3002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:43.783327 3002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:43.784476 3002 hybrid_clock.cc:648] HybridClock initialized: now 1786242223784460 us; error 31 us; skew 500 ppm
Aug 09 02:23:43 dist-test-slave-w206 krb5kdc[2830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242223, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:43.786856 3002 init.cc:377] Logged in from keytab as kudu/127.11.93.188@KRBTEST.COM (short username kudu)
I20260809 02:23:43.787314 3002 webserver.cc:460] Webserver started at http://127.11.93.188:38753/ using document root <none> and password file <none>
I20260809 02:23:43.787559 3002 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:43.787627 3002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:43.787763 3002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:43.788808 3002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-2/data/instance:
uuid: "a2bbb84e22374d5ca6a56661ac4804b2"
format_stamp: "Formatted at 2026-08-09 02:23:43 on dist-test-slave-w206"
server_key: "76453066b7da2d36c498bc36d49ed58d"
server_key_iv: "64c2986c8a6b95ce5f3db77cfed789fc"
server_key_version: "encryptionkey@0"
I20260809 02:23:43.789134 3002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-2/wal/instance:
uuid: "a2bbb84e22374d5ca6a56661ac4804b2"
format_stamp: "Formatted at 2026-08-09 02:23:43 on dist-test-slave-w206"
server_key: "76453066b7da2d36c498bc36d49ed58d"
server_key_iv: "64c2986c8a6b95ce5f3db77cfed789fc"
server_key_version: "encryptionkey@0"
I20260809 02:23:43.790382 3002 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 02:23:43.791093 3017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:43.791265 3002 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 02:23:43.791373 3002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-2/wal
uuid: "a2bbb84e22374d5ca6a56661ac4804b2"
format_stamp: "Formatted at 2026-08-09 02:23:43 on dist-test-slave-w206"
server_key: "76453066b7da2d36c498bc36d49ed58d"
server_key_iv: "64c2986c8a6b95ce5f3db77cfed789fc"
server_key_version: "encryptionkey@0"
I20260809 02:23:43.791456 3002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:43.802109 2995 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } attempt: 2
I20260809 02:23:43.802501 2998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.802360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:44339 (local address 127.0.0.1:58484)
0809 02:23:43.802434 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.802463 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:44339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 02:23:43.802793 2998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.802709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:44339 (local address 127.0.0.1:58500)
0809 02:23:43.802749 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.802772 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:44339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260809 02:23:43.802883 2995 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.188:44339: Network error: Client connection negotiation failed: client connection to 127.11.93.188:44339: connect: Connection refused (error 111)
I20260809 02:23:43.803299 3002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:43.805068 3002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:43.805226 3002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:43.809113 3002 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.188:44339
I20260809 02:23:43.809144 3074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.188:44339 every 8 connection(s)
I20260809 02:23:43.809494 3002 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-2/data/info.pb
I20260809 02:23:43.810431 3075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:43.811973 3075 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38463 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:23:43.815164 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 3002
I20260809 02:23:43.815295 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786241951749734-11638-0/minicluster-data/master-2/wal/instance
I20260809 02:23:43.815508 11638 external_mini_cluster.cc:1428] Setting key 5c6f1a4c9df0071ceeb2961cfeb4ffa7
Aug 09 02:23:43 dist-test-slave-w206 krb5kdc[2830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242223, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.188@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
Aug 09 02:23:43 dist-test-slave-w206 krb5kdc[2830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242223, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.188@KRBTEST.COM
I20260809 02:23:43.821938 2920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.812614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41714 (local address 127.11.93.190:38463)
0809 02:23:43.812677 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:43.812680 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:43.812855 (+ 175us) server_negotiation.cc:407] Connection header received
0809 02:23:43.813376 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:43.813378 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:43.813391 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:43.813454 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:43.814049 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.814515 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.815606 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.815805 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.815895 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.818212 (+ 2317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:43.818214 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:43.818214 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:43.818221 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:43.819970 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.820361 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.820363 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.820363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.820429 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.821201 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.821203 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.821203 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.821357 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:43.821430 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:43.821747 (+ 317us) server_negotiation.cc:299] Negotiation successful
0809 02:23:43.821835 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 02:23:43.822094 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.812592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:38463 (local address 127.0.0.1:41714)
0809 02:23:43.812743 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.812776 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:43.813220 (+ 444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:43.813524 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:43.813528 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:43.813761 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:43.813942 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:43.813945 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.814616 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.814617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:43.815523 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:43.815526 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.815941 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.815943 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:43.816083 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.816594 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:43.816605 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:43.818125 (+ 1520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:43.820050 (+ 1925us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:43.820057 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:43.820059 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:43.820282 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:43.821011 (+ 729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:43.821012 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:43.821013 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:43.821126 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:43.821432 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:43.821438 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:43.821593 (+ 155us) client_negotiation.cc:769] Sending connection context
0809 02:23:43.821715 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 02:23:43.821828 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":74,"threads_started":1}
I20260809 02:23:43.822892 3075 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:23:43.824551 3079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.815906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58502 (local address 127.11.93.188:44339)
0809 02:23:43.816054 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:43.816058 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:43.816103 (+ 45us) server_negotiation.cc:407] Connection header received
0809 02:23:43.816155 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:43.816157 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:43.816173 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:43.816235 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:43.816995 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.817622 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.818518 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.818906 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.818962 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.821436 (+ 2474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:43.821441 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:43.821441 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:43.821448 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:43.823337 (+ 1889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.823735 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.823737 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.823738 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.823801 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.823993 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.823994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.823994 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.824158 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:43.824282 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:43.824345 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 02:23:43.824419 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":93,"threads_started":1}
Aug 09 02:23:43 dist-test-slave-w206 krb5kdc[2830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242223, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.188@KRBTEST.COM for kudu/127.11.93.189@KRBTEST.COM
Aug 09 02:23:43 dist-test-slave-w206 krb5kdc[2830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242223, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:23:43.829993 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.823206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:40587 (local address 127.0.0.1:38072)
0809 02:23:43.823253 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.823264 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:43.823331 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:43.823481 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:43.823482 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:43.823620 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:43.823655 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:43.823657 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.824521 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.824522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:43.825114 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:43.825117 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.825614 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.825615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:43.825679 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.826007 (+ 328us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:43.826012 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:43.827177 (+ 1165us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:43.828820 (+ 1643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:43.828821 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:43.828821 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:43.829037 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:43.829288 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:43.829289 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:43.829290 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:43.829363 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:43.829683 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:43.829684 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:43.829729 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 02:23:43.829810 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 02:23:43.829910 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260809 02:23:43.830142 3000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.823295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38072 (local address 127.11.93.189:40587)
0809 02:23:43.823377 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:43.823379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:43.823388 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:23:43.823415 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:43.823416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:43.823426 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:43.823483 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:43.823726 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.824434 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.825215 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.825539 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.825603 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.827271 (+ 1668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:43.827272 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:43.827272 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:43.827280 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:43.828716 (+ 1436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.829130 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.829132 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.829132 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.829198 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.829471 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.829473 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.829473 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.829602 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:43.829662 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:43.829846 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 02:23:43.829953 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 02:23:43.830463 3075 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:23:43.832801 2920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.825379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41722 (local address 127.11.93.190:38463)
0809 02:23:43.825414 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:43.825416 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:43.825423 (+ 7us) server_negotiation.cc:407] Connection header received
0809 02:23:43.825485 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:43.825486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:43.825495 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:43.825550 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:43.826142 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.826582 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.827368 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.827571 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.827661 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.829901 (+ 2240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:43.829902 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:43.829903 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:43.829909 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:43.831680 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.832048 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.832048 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.832049 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.832098 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.832312 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.832313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.832313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.832463 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:43.832585 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:43.832685 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 02:23:43.832740 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
Aug 09 02:23:43 dist-test-slave-w206 krb5kdc[2830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242223, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.188@KRBTEST.COM for kudu/127.11.93.188@KRBTEST.COM
Aug 09 02:23:43 dist-test-slave-w206 krb5kdc[2830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242223, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.189@KRBTEST.COM
I20260809 02:23:43.837985 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.830701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:44339 (local address 127.0.0.1:58512)
0809 02:23:43.830752 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.830762 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:43.830799 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:43.831136 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:43.831137 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:43.831273 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:43.831307 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:43.831309 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.832400 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.832401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:43.833120 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:43.833122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.833655 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.833656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:43.833686 (+ 30us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.834071 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:43.834076 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:43.835248 (+ 1172us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:43.836885 (+ 1637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:43.836887 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:43.836887 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:43.837099 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:43.837315 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:43.837316 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:43.837316 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:43.837367 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:43.837640 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:43.837641 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:43.837687 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 02:23:43.837783 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 02:23:43.837877 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 02:23:43.838037 3079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.830935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58512 (local address 127.11.93.188:44339)
0809 02:23:43.831019 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:43.831021 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:43.831028 (+ 7us) server_negotiation.cc:407] Connection header received
0809 02:23:43.831043 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:43.831044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:43.831053 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:43.831102 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:43.831543 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.832320 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.833208 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.833546 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.833608 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.835356 (+ 1748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:43.835357 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:43.835357 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:43.835363 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:43.836802 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.837168 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.837169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.837169 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.837224 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.837430 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.837431 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.837431 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.837551 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:43.837621 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:43.837814 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 02:23:43.837925 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":48,"server-negotiator.queue_time_us":34}
I20260809 02:23:43.839589 3075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2bbb84e22374d5ca6a56661ac4804b2: Bootstrap starting.
I20260809 02:23:43.840437 3075 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2bbb84e22374d5ca6a56661ac4804b2: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:43.840763 3000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.833645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38080 (local address 127.11.93.189:40587)
0809 02:23:43.833680 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:43.833682 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:43.833690 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:23:43.833712 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:43.833713 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:43.833721 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:43.833770 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:43.834218 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.834652 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.835520 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.835737 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.835814 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.838015 (+ 2201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:43.838017 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:43.838017 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:43.838024 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:43.839638 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.840020 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.840021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.840021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.840080 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.840278 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.840279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.840279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.840395 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:43.840562 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:43.840600 (+ 38us) server_negotiation.cc:299] Negotiation successful
0809 02:23:43.840667 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 02:23:43.840747 3075 log.cc:824] T 00000000000000000000000000000000 P a2bbb84e22374d5ca6a56661ac4804b2: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:43.841660 3075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2bbb84e22374d5ca6a56661ac4804b2: No bootstrap required, opened a new log
I20260809 02:23:43.842190 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:23:43.843408 3075 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2bbb84e22374d5ca6a56661ac4804b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa082c9b3ee849ebac299db65fab07da" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38463 } } peers { permanent_uuid: "0ca90f4388d94283a343df448c1f737a" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } } peers { permanent_uuid: "a2bbb84e22374d5ca6a56661ac4804b2" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } }
I20260809 02:23:43.843554 3075 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2bbb84e22374d5ca6a56661ac4804b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2bbb84e22374d5ca6a56661ac4804b2, State: Initialized, Role: FOLLOWER
I20260809 02:23:43.843643 3075 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2bbb84e22374d5ca6a56661ac4804b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa082c9b3ee849ebac299db65fab07da" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38463 } } peers { permanent_uuid: "0ca90f4388d94283a343df448c1f737a" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } } peers { permanent_uuid: "a2bbb84e22374d5ca6a56661ac4804b2" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } }
I20260809 02:23:43.843945 3081 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2bbb84e22374d5ca6a56661ac4804b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa082c9b3ee849ebac299db65fab07da" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38463 } } peers { permanent_uuid: "0ca90f4388d94283a343df448c1f737a" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } } peers { permanent_uuid: "a2bbb84e22374d5ca6a56661ac4804b2" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } } }
I20260809 02:23:43.844013 3075 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2bbb84e22374d5ca6a56661ac4804b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:43.844038 3081 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2bbb84e22374d5ca6a56661ac4804b2 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:23:43.843379 2888 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "aa082c9b3ee849ebac299db65fab07da"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41722
W20260809 02:23:43.845770 3092 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a2bbb84e22374d5ca6a56661ac4804b2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:23:43.845834 3092 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:23:43.846143 3002 master_runner.cc:186] Error getting master registration for 127.11.93.190:38463: OK, instance_id { permanent_uuid: "aa082c9b3ee849ebac299db65fab07da" instance_seqno: 1786242223511250 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 02:23:43.848781 3002 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:23:43.856506 2916 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } attempt: 2
Aug 09 02:23:43 dist-test-slave-w206 krb5kdc[2830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242223, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for kudu/127.11.93.188@KRBTEST.COM
I20260809 02:23:43.864205 2919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.856778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:44339 (local address 127.0.0.1:58518)
0809 02:23:43.856842 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.856854 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:43.856898 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:43.857028 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:43.857029 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:43.857215 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:43.857266 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:43.857268 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.857894 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.857895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:43.858698 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:43.858699 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.859054 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.859055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:43.859112 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.859615 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:43.859621 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:43.861187 (+ 1566us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:43.863059 (+ 1872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:43.863060 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:43.863061 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:43.863290 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:43.863501 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:43.863501 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:43.863502 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:43.863569 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:43.863871 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:43.863872 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:43.863922 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 02:23:43.864006 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 02:23:43.864100 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 02:23:43.864208 3079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.856857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58518 (local address 127.11.93.188:44339)
0809 02:23:43.856915 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:43.856917 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:43.856926 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:23:43.856948 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:43.856949 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:43.856959 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:43.857024 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:43.857338 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.857801 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.858761 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.858962 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.859057 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.861273 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:43.861275 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:43.861275 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:43.861283 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:43.862946 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.863369 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.863370 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.863371 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.863430 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.863634 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.863635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.863636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.863797 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:43.863862 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:43.864039 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 02:23:43.864115 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 02:23:43.865892 2916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da: Bootstrap starting.
I20260809 02:23:43.866624 2916 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:43.866948 2916 log.cc:824] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:43.867841 2916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da: No bootstrap required, opened a new log
I20260809 02:23:43.869217 2916 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa082c9b3ee849ebac299db65fab07da" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38463 } } peers { permanent_uuid: "0ca90f4388d94283a343df448c1f737a" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } } peers { permanent_uuid: "a2bbb84e22374d5ca6a56661ac4804b2" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } }
I20260809 02:23:43.869378 2916 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa082c9b3ee849ebac299db65fab07da, State: Initialized, Role: FOLLOWER
I20260809 02:23:43.869460 2916 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa082c9b3ee849ebac299db65fab07da" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38463 } } peers { permanent_uuid: "0ca90f4388d94283a343df448c1f737a" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } } peers { permanent_uuid: "a2bbb84e22374d5ca6a56661ac4804b2" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } }
I20260809 02:23:43.869784 2916 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:43.869813 2888 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 02:23:43.869755 3095 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa082c9b3ee849ebac299db65fab07da" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38463 } } peers { permanent_uuid: "0ca90f4388d94283a343df448c1f737a" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } } peers { permanent_uuid: "a2bbb84e22374d5ca6a56661ac4804b2" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } } }
I20260809 02:23:43.869880 2888 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:43.870677 2888 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa082c9b3ee849ebac299db65fab07da" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38463 } } peers { permanent_uuid: "0ca90f4388d94283a343df448c1f737a" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } } peers { permanent_uuid: "a2bbb84e22374d5ca6a56661ac4804b2" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } }
I20260809 02:23:43.870940 2888 leader_election.cc:288] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da [CANDIDATE]: Term 1 election: Requested vote from peers 0ca90f4388d94283a343df448c1f737a (127.11.93.189:40587), a2bbb84e22374d5ca6a56661ac4804b2 (127.11.93.188:44339)
I20260809 02:23:43.871181 3095 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:23:43.871464 3046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aa082c9b3ee849ebac299db65fab07da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a2bbb84e22374d5ca6a56661ac4804b2"
I20260809 02:23:43.871589 3046 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2bbb84e22374d5ca6a56661ac4804b2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:43.872468 3046 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a2bbb84e22374d5ca6a56661ac4804b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa082c9b3ee849ebac299db65fab07da in term 1.
I20260809 02:23:43.872701 2861 leader_election.cc:302] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2bbb84e22374d5ca6a56661ac4804b2, aa082c9b3ee849ebac299db65fab07da; no voters:
I20260809 02:23:43.872977 3095 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:43.873150 3095 raft_consensus.cc:686] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da [term 1 LEADER]: Becoming Leader. State: Replica: aa082c9b3ee849ebac299db65fab07da, State: Running, Role: LEADER
I20260809 02:23:43.873241 3095 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa082c9b3ee849ebac299db65fab07da" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38463 } } peers { permanent_uuid: "0ca90f4388d94283a343df448c1f737a" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } } peers { permanent_uuid: "a2bbb84e22374d5ca6a56661ac4804b2" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } }
I20260809 02:23:43.873642 3095 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa082c9b3ee849ebac299db65fab07da. Latest consensus state: current_term: 1 leader_uuid: "aa082c9b3ee849ebac299db65fab07da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa082c9b3ee849ebac299db65fab07da" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38463 } } peers { permanent_uuid: "0ca90f4388d94283a343df448c1f737a" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } } peers { permanent_uuid: "a2bbb84e22374d5ca6a56661ac4804b2" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } } }
I20260809 02:23:43.873718 3095 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:43.875990 2844 master_runner.cc:186] Error getting master registration for 127.11.93.189:40587: OK, instance_id { permanent_uuid: "0ca90f4388d94283a343df448c1f737a" instance_seqno: 1786242223657332 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 02:23:43.878690 2844 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:23:43.879519 3114 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:43.880086 3114 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:43.880928 3079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.872617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58526 (local address 127.11.93.188:44339)
0809 02:23:43.872716 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:43.872718 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:43.872944 (+ 226us) server_negotiation.cc:407] Connection header received
0809 02:23:43.873111 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:43.873112 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:43.873135 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:43.873166 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:43.874213 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.874881 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.875871 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.876157 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.876194 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.877868 (+ 1674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:43.877870 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:43.877870 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:43.877877 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:43.879624 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.880038 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.880039 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.880040 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.880100 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.880320 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.880321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.880322 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.880451 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:43.880522 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:43.880734 (+ 212us) server_negotiation.cc:299] Negotiation successful
0809 02:23:43.880828 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 02:23:43.882812 3046 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a2bbb84e22374d5ca6a56661ac4804b2 [term 1 FOLLOWER]: Refusing update from remote peer aa082c9b3ee849ebac299db65fab07da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:43.882831 2920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.872676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41738 (local address 127.11.93.190:38463)
0809 02:23:43.872839 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:43.872841 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:43.872850 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:23:43.872870 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:43.872871 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:43.872880 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:43.872939 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:43.874008 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.874757 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.876492 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.876787 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.876829 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.879789 (+ 2960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:43.879791 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:43.879791 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:43.879799 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:43.881457 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.881882 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.881883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.881883 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.881942 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.882182 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.882183 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.882184 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.882316 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:43.882392 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:43.882622 (+ 230us) server_negotiation.cc:299] Negotiation successful
0809 02:23:43.882702 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141}
I20260809 02:23:43.883476 3112 consensus_queue.cc:1035] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2bbb84e22374d5ca6a56661ac4804b2" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:43.885365 3081 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2bbb84e22374d5ca6a56661ac4804b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa082c9b3ee849ebac299db65fab07da. Latest consensus state: current_term: 1 leader_uuid: "aa082c9b3ee849ebac299db65fab07da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa082c9b3ee849ebac299db65fab07da" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38463 } } peers { permanent_uuid: "0ca90f4388d94283a343df448c1f737a" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } } peers { permanent_uuid: "a2bbb84e22374d5ca6a56661ac4804b2" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } } }
I20260809 02:23:43.885461 3081 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2bbb84e22374d5ca6a56661ac4804b2 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:23:43.886029 3000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.872770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38082 (local address 127.11.93.189:40587)
0809 02:23:43.872816 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:43.872818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:43.872828 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:23:43.872854 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:43.872855 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:43.872866 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:43.872920 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:43.877687 (+ 4767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.879015 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.881238 (+ 2223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.881500 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.881568 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.883049 (+ 1481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:43.883050 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:43.883051 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:43.883059 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:43.884758 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.885126 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.885127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.885127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.885183 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.885405 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.885406 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.885406 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.885538 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:43.885629 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:43.885819 (+ 190us) server_negotiation.cc:299] Negotiation successful
0809 02:23:43.885912 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 02:23:43.886854 3114 catalog_manager.cc:1347] Generated new cluster ID: 2c77920162d745bba0bc20784844da34
I20260809 02:23:43.886952 3114 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:43.886942 3095 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aa082c9b3ee849ebac299db65fab07da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa082c9b3ee849ebac299db65fab07da" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38463 } } peers { permanent_uuid: "0ca90f4388d94283a343df448c1f737a" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } } peers { permanent_uuid: "a2bbb84e22374d5ca6a56661ac4804b2" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } } }
I20260809 02:23:43.887056 3095 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:43.887228 3081 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2bbb84e22374d5ca6a56661ac4804b2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aa082c9b3ee849ebac299db65fab07da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa082c9b3ee849ebac299db65fab07da" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38463 } } peers { permanent_uuid: "0ca90f4388d94283a343df448c1f737a" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } } peers { permanent_uuid: "a2bbb84e22374d5ca6a56661ac4804b2" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } } }
I20260809 02:23:43.887313 3081 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2bbb84e22374d5ca6a56661ac4804b2 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:23:43.887542 3119 mvcc.cc:205] Tried to move back new op lower bound from 7316448149021212672 to 7316448148985483264. Current Snapshot: MvccSnapshot[applied={T|T < 7316448149021212672}]
I20260809 02:23:43.893967 2995 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } attempt: 3
Aug 09 02:23:43 dist-test-slave-w206 krb5kdc[2830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242223, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.189@KRBTEST.COM for kudu/127.11.93.188@KRBTEST.COM
I20260809 02:23:43.900061 3114 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:43.900764 3114 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:23:43.903326 2998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.894240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:44339 (local address 127.0.0.1:58542)
0809 02:23:43.894319 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:43.894346 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:43.894387 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:43.894644 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:43.894645 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:43.894817 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:43.894863 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:43.894865 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.895861 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.895862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:43.896678 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:43.896680 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.897235 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.897236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:43.897304 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.898668 (+ 1364us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:43.898673 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:43.900349 (+ 1676us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:43.902190 (+ 1841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:43.902191 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:43.902191 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:43.902420 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:43.902667 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:43.902668 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:43.902668 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:43.902730 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:43.903036 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:43.903037 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:43.903087 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 02:23:43.903142 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 02:23:43.903228 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 02:23:43.903698 3079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:43.894457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58542 (local address 127.11.93.188:44339)
0809 02:23:43.894526 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:43.894528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:43.894534 (+ 6us) server_negotiation.cc:407] Connection header received
0809 02:23:43.894553 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:43.894554 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:43.894562 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:43.894605 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:43.894959 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.895749 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.896802 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:43.897112 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:43.897169 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:43.900443 (+ 3274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:43.900445 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:43.900445 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:43.900451 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:43.902110 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.902522 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.902523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.902523 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.902592 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:43.902799 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:43.902800 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:43.902800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:43.902921 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:43.903001 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:43.903519 (+ 518us) server_negotiation.cc:299] Negotiation successful
0809 02:23:43.903603 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 02:23:43.905614 2995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ca90f4388d94283a343df448c1f737a: Bootstrap starting.
I20260809 02:23:43.905946 3114 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da: Generated new TSK 0
I20260809 02:23:43.906220 3114 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:43.906328 2995 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ca90f4388d94283a343df448c1f737a: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:43.906615 2995 log.cc:824] T 00000000000000000000000000000000 P 0ca90f4388d94283a343df448c1f737a: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:43.915692 2995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ca90f4388d94283a343df448c1f737a: No bootstrap required, opened a new log
I20260809 02:23:43.917706 2995 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ca90f4388d94283a343df448c1f737a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa082c9b3ee849ebac299db65fab07da" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38463 } } peers { permanent_uuid: "0ca90f4388d94283a343df448c1f737a" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } } peers { permanent_uuid: "a2bbb84e22374d5ca6a56661ac4804b2" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } }
I20260809 02:23:43.917857 2995 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ca90f4388d94283a343df448c1f737a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ca90f4388d94283a343df448c1f737a, State: Initialized, Role: FOLLOWER
I20260809 02:23:43.917941 2995 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ca90f4388d94283a343df448c1f737a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa082c9b3ee849ebac299db65fab07da" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38463 } } peers { permanent_uuid: "0ca90f4388d94283a343df448c1f737a" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } } peers { permanent_uuid: "a2bbb84e22374d5ca6a56661ac4804b2" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } }
I20260809 02:23:43.918273 2995 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ca90f4388d94283a343df448c1f737a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:43.918316 2968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aa082c9b3ee849ebac299db65fab07da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "0ca90f4388d94283a343df448c1f737a"
I20260809 02:23:43.918432 2968 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ca90f4388d94283a343df448c1f737a [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:43.919437 2968 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0ca90f4388d94283a343df448c1f737a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa082c9b3ee849ebac299db65fab07da in term 1.
I20260809 02:23:43.919693 2967 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0ca90f4388d94283a343df448c1f737a [term 1 FOLLOWER]: Refusing update from remote peer aa082c9b3ee849ebac299db65fab07da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:43.920463 3122 consensus_queue.cc:1035] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ca90f4388d94283a343df448c1f737a" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:43.923251 3127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ca90f4388d94283a343df448c1f737a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aa082c9b3ee849ebac299db65fab07da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa082c9b3ee849ebac299db65fab07da" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38463 } } peers { permanent_uuid: "0ca90f4388d94283a343df448c1f737a" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } } peers { permanent_uuid: "a2bbb84e22374d5ca6a56661ac4804b2" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } } }
I20260809 02:23:43.923353 3127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ca90f4388d94283a343df448c1f737a [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:23:43.923408 3127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ca90f4388d94283a343df448c1f737a [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa082c9b3ee849ebac299db65fab07da. Latest consensus state: current_term: 1 leader_uuid: "aa082c9b3ee849ebac299db65fab07da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa082c9b3ee849ebac299db65fab07da" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38463 } } peers { permanent_uuid: "0ca90f4388d94283a343df448c1f737a" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } } peers { permanent_uuid: "a2bbb84e22374d5ca6a56661ac4804b2" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } } }
I20260809 02:23:43.923456 3127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ca90f4388d94283a343df448c1f737a [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:23:43.923488 3127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ca90f4388d94283a343df448c1f737a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aa082c9b3ee849ebac299db65fab07da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa082c9b3ee849ebac299db65fab07da" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38463 } } peers { permanent_uuid: "0ca90f4388d94283a343df448c1f737a" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } } peers { permanent_uuid: "a2bbb84e22374d5ca6a56661ac4804b2" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } } }
I20260809 02:23:43.923534 3127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ca90f4388d94283a343df448c1f737a [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:23:43.924247 3141 mvcc.cc:205] Tried to move back new op lower bound from 7316448149110829056 to 7316448148985483264. Current Snapshot: MvccSnapshot[applied={T|T < 7316448149021212672}]
W20260809 02:23:43.924257 3139 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0ca90f4388d94283a343df448c1f737a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:23:43.924391 3139 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260809 02:23:43.953063 2920 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:43.951350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41746 (local address 127.11.93.190:38463)
0809 02:23:43.951399 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:43.951402 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:43.952353 (+ 951us) server_negotiation.cc:407] Connection header received
0809 02:23:43.952463 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:43.952464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:43.952475 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:43.952506 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:43.952979 (+ 473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41746: BlockingRecv error: recv got EOF from 127.0.0.1:41746 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260809 02:23:43.953817 3000 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:43.951820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38088 (local address 127.11.93.189:40587)
0809 02:23:43.951861 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:43.951863 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:43.953312 (+ 1449us) server_negotiation.cc:407] Connection header received
0809 02:23:43.953411 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:43.953412 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:43.953423 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:43.953455 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:43.953755 (+ 300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38088: BlockingRecv error: recv got EOF from 127.0.0.1:38088 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260809 02:23:43.954535 3079 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:43.952101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58556 (local address 127.11.93.188:44339)
0809 02:23:43.952138 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:43.952140 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:43.954045 (+ 1905us) server_negotiation.cc:407] Connection header received
0809 02:23:43.954139 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:43.954140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:43.954151 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:43.954180 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:43.954478 (+ 298us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58556: BlockingRecv error: recv got EOF from 127.0.0.1:58556 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 02:23:43.963797 3000 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:43.959199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38098 (local address 127.11.93.189:40587)
0809 02:23:43.959234 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:43.959236 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:43.963189 (+ 3953us) server_negotiation.cc:407] Connection header received
0809 02:23:43.963319 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:43.963321 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:43.963341 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:43.963373 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:43.963741 (+ 368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38098: BlockingRecv error: recv got EOF from 127.0.0.1:38098 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260809 02:23:43.966876 3000 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:43.966150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38112 (local address 127.11.93.189:40587)
0809 02:23:43.966183 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:43.966185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:43.966406 (+ 221us) server_negotiation.cc:407] Connection header received
0809 02:23:43.966494 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:43.966495 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:43.966505 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:43.966532 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:43.966827 (+ 295us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38112: BlockingRecv error: recv got EOF from 127.0.0.1:38112 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260809 02:23:43.971055 3000 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:43.970155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38124 (local address 127.11.93.189:40587)
0809 02:23:43.970201 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:43.970203 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:43.970476 (+ 273us) server_negotiation.cc:407] Connection header received
0809 02:23:43.970570 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:43.970571 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:43.970581 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:43.970609 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:43.970922 (+ 313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38124: BlockingRecv error: recv got EOF from 127.0.0.1:38124 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260809 02:23:43.977159 3000 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:43.976362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38130 (local address 127.11.93.189:40587)
0809 02:23:43.976398 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:43.976400 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:43.976627 (+ 227us) server_negotiation.cc:407] Connection header received
0809 02:23:43.976726 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:43.976727 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:43.976738 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:43.976768 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:43.977112 (+ 344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38130: BlockingRecv error: recv got EOF from 127.0.0.1:38130 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260809 02:23:43.987406 3000 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:43.986454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38134 (local address 127.11.93.189:40587)
0809 02:23:43.986506 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:43.986508 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:43.986748 (+ 240us) server_negotiation.cc:407] Connection header received
0809 02:23:43.986852 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:43.986853 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:43.986865 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:43.986896 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:43.987352 (+ 456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38134: BlockingRecv error: recv got EOF from 127.0.0.1:38134 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 02:23:44.005844 3000 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:44.004876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38136 (local address 127.11.93.189:40587)
0809 02:23:44.004923 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:44.004925 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:44.005195 (+ 270us) server_negotiation.cc:407] Connection header received
0809 02:23:44.005318 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:44.005319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:44.005332 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:44.005364 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:44.005779 (+ 415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38136: BlockingRecv error: recv got EOF from 127.0.0.1:38136 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260809 02:23:44.040413 3000 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:44.039429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38150 (local address 127.11.93.189:40587)
0809 02:23:44.039480 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:44.039482 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:44.039745 (+ 263us) server_negotiation.cc:407] Connection header received
0809 02:23:44.039850 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:44.039852 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:44.039865 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:44.039895 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:44.040352 (+ 457us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38150: BlockingRecv error: recv got EOF from 127.0.0.1:38150 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260809 02:23:44.106657 3000 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:44.105880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38154 (local address 127.11.93.189:40587)
0809 02:23:44.105954 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:44.105956 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:44.106051 (+ 95us) server_negotiation.cc:407] Connection header received
0809 02:23:44.106123 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:44.106123 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:44.106133 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:44.106196 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:44.106585 (+ 389us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38154: BlockingRecv error: recv got EOF from 127.0.0.1:38154 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260809 02:23:44.237622 3000 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:44.236032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38170 (local address 127.11.93.189:40587)
0809 02:23:44.236118 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:44.236121 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:44.236291 (+ 170us) server_negotiation.cc:407] Connection header received
0809 02:23:44.236432 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:44.236434 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:44.236465 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:44.236529 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:44.237557 (+ 1028us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38170: BlockingRecv error: recv got EOF from 127.0.0.1:38170 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260809 02:23:44.495070 3000 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:44.494235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38184 (local address 127.11.93.189:40587)
0809 02:23:44.494323 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:44.494325 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:44.494443 (+ 118us) server_negotiation.cc:407] Connection header received
0809 02:23:44.494541 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:44.494542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:44.494557 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:44.494611 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:44.495002 (+ 391us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38184: BlockingRecv error: recv got EOF from 127.0.0.1:38184 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 02:23:44.544195 3210 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aa082c9b3ee849ebac299db65fab07da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa082c9b3ee849ebac299db65fab07da" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 38463 } } peers { permanent_uuid: "0ca90f4388d94283a343df448c1f737a" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 40587 } } peers { permanent_uuid: "a2bbb84e22374d5ca6a56661ac4804b2" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 44339 } } }
I20260809 02:23:44.544396 3210 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa082c9b3ee849ebac299db65fab07da [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:44.846279 3092 catalog_manager.cc:1259] Loaded cluster ID: 2c77920162d745bba0bc20784844da34
I20260809 02:23:44.846361 3092 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a2bbb84e22374d5ca6a56661ac4804b2: loading cluster ID for follower catalog manager: success
I20260809 02:23:44.847218 3092 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a2bbb84e22374d5ca6a56661ac4804b2: acquiring CA information for follower catalog manager: success
I20260809 02:23:44.847558 3092 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a2bbb84e22374d5ca6a56661ac4804b2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:23:44.924822 3139 catalog_manager.cc:1259] Loaded cluster ID: 2c77920162d745bba0bc20784844da34
I20260809 02:23:44.924898 3139 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0ca90f4388d94283a343df448c1f737a: loading cluster ID for follower catalog manager: success
I20260809 02:23:44.925725 3139 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0ca90f4388d94283a343df448c1f737a: acquiring CA information for follower catalog manager: success
I20260809 02:23:44.926052 3139 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0ca90f4388d94283a343df448c1f737a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:23:45.011379 3217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:45.008646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38200 (local address 127.11.93.189:40587)
0809 02:23:45.008801 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:45.008803 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:45.008828 (+ 25us) server_negotiation.cc:407] Connection header received
0809 02:23:45.008912 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:45.008913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:45.008965 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:45.009037 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:45.009171 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:45.009662 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:45.010432 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:45.010621 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:45.010674 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:45.010820 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:45.010935 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:45.011112 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:45.011251 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 02:23:45.011287 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":94,"threads_started":1}
I20260809 02:23:45.015779 3223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:45.013294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58564 (local address 127.11.93.188:44339)
0809 02:23:45.013429 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:45.013431 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:45.013440 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:23:45.013484 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:45.013485 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:45.013533 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:45.013601 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:45.013729 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:45.014231 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:45.014952 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:45.015193 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:45.015283 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:45.015443 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:45.015542 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:45.015619 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:45.015670 (+ 51us) server_negotiation.cc:299] Negotiation successful
0809 02:23:45.015691 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":65,"threads_started":1}
I20260809 02:23:45.020761 3217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:45.017575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38210 (local address 127.11.93.189:40587)
0809 02:23:45.017612 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:45.017614 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:45.017716 (+ 102us) server_negotiation.cc:407] Connection header received
0809 02:23:45.017776 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:45.017777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:45.017787 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:45.017857 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:45.017979 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:45.018732 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:45.019969 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:45.020262 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:45.020321 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:45.020508 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:45.020539 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:45.020585 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:45.020653 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 02:23:45.020672 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 02:23:45.020881 3223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:45.017763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58574 (local address 127.11.93.188:44339)
0809 02:23:45.017799 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:45.017801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:45.017991 (+ 190us) server_negotiation.cc:407] Connection header received
0809 02:23:45.018089 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:45.018090 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:45.018099 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:45.018150 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:45.018291 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:45.019035 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:45.020065 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:45.020361 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:45.020417 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:45.020585 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:45.020616 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:45.020672 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:45.020779 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 02:23:45.020799 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 02:23:45.020963 3230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:45.017429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41756 (local address 127.11.93.190:38463)
0809 02:23:45.017541 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:45.017544 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:45.017553 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:23:45.017597 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:45.017598 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:45.017648 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:45.017727 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:45.017929 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:45.018806 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:45.019990 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:45.020240 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:45.020318 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:45.020524 (+ 206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:45.020635 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:45.020692 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:45.020851 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 02:23:45.020874 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":58,"threads_started":1}
I20260809 02:23:45.022771 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 2844
I20260809 02:23:45.030613 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 2924
I20260809 02:23:45.036276 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 3002
2026-08-09T02:23:45Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2868 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:23:45 dist-test-slave-w206 krb5kdc[3235](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:23:45 dist-test-slave-w206 krb5kdc[3235](info): set up 2 sockets
Aug 09 02:23:45 dist-test-slave-w206 krb5kdc[3235](info): commencing operation
krb5kdc: starting...
W20260809 02:23:46.118494 11638 mini_kdc.cc:121] Time spent starting KDC: real 1.062s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/test-user.keytab.
Aug 09 02:23:46 dist-test-slave-w206 krb5kdc[3235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242226, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:23:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:23:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.93.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
Entry for principal kudu/127.11.93.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab.
I20260809 02:23:46.246193 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:36163
--webserver_interface=127.11.93.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:45431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:36163,127.11.93.189:32801,127.11.93.188:43755
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:23:46.328711 3248 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 02:23:46.328923 3248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:46.328940 3248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:46.328961 3248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:46.330035 3248 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:46.330068 3248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:46.330082 3248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:46.330096 3248 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:46.330107 3248 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:46.331598 3248 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:45431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:36163,127.11.93.189:32801,127.11.93.188:43755
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.190.keytab
--principal=kudu/127.11.93.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.190:36163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.93.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3248
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:46.331790 3248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:46.331959 3248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:46.336828 3253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:46.336898 3254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:46.336869 3256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:46.337087 3248 server_base.cc:1034] running on GCE node
I20260809 02:23:46.337402 3248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:46.337682 3248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:46.338835 3248 hybrid_clock.cc:648] HybridClock initialized: now 1786242226338814 us; error 33 us; skew 500 ppm
Aug 09 02:23:46 dist-test-slave-w206 krb5kdc[3235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242226, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:46.341542 3248 init.cc:377] Logged in from keytab as kudu/127.11.93.190@KRBTEST.COM (short username kudu)
I20260809 02:23:46.341955 3248 webserver.cc:460] Webserver started at http://127.11.93.190:37947/ using document root <none> and password file <none>
I20260809 02:23:46.342177 3248 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:46.342253 3248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:46.342402 3248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:46.343521 3248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-0/data/instance:
uuid: "6a690899dd0b4dde80eec84e767dc19b"
format_stamp: "Formatted at 2026-08-09 02:23:46 on dist-test-slave-w206"
server_key: "9154b1b76435abb1787e284e7c34766c"
server_key_iv: "1d32f8532177bc48b6150bcc26a9d12e"
server_key_version: "encryptionkey@0"
I20260809 02:23:46.343881 3248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-0/wal/instance:
uuid: "6a690899dd0b4dde80eec84e767dc19b"
format_stamp: "Formatted at 2026-08-09 02:23:46 on dist-test-slave-w206"
server_key: "9154b1b76435abb1787e284e7c34766c"
server_key_iv: "1d32f8532177bc48b6150bcc26a9d12e"
server_key_version: "encryptionkey@0"
I20260809 02:23:46.345271 3248 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:23:46.345974 3263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:46.346145 3248 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 02:23:46.346282 3248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-0/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-0/wal
uuid: "6a690899dd0b4dde80eec84e767dc19b"
format_stamp: "Formatted at 2026-08-09 02:23:46 on dist-test-slave-w206"
server_key: "9154b1b76435abb1787e284e7c34766c"
server_key_iv: "1d32f8532177bc48b6150bcc26a9d12e"
server_key_version: "encryptionkey@0"
I20260809 02:23:46.346364 3248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:46.364742 3248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:46.367228 3248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:46.367401 3248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:46.371491 3248 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.190:36163
I20260809 02:23:46.371631 3319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.190:36163 every 8 connection(s)
I20260809 02:23:46.371927 3248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-0/data/info.pb
I20260809 02:23:46.372959 3320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:46.374485 3320 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.190" port: 36163 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:23:46 dist-test-slave-w206 krb5kdc[3235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242226, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:23:46.381590 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 3248
I20260809 02:23:46.381811 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-0/wal/instance
I20260809 02:23:46.382023 11638 external_mini_cluster.cc:1428] Setting key bb7e9b9d4e1f819b52540264561e5c46
I20260809 02:23:46.384171 3322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.375168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:36163 (local address 127.0.0.1:44990)
0809 02:23:46.375348 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.375392 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:46.375847 (+ 455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:46.376100 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:46.376102 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:46.376344 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:46.376494 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:46.376498 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.377492 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.377493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:46.378155 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:46.378157 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.378636 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.378636 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:46.378687 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.379195 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:46.379202 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:46.380561 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:46.382451 (+ 1890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:46.382459 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:46.382461 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:46.382733 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:46.383064 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:46.383065 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:46.383066 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:46.383180 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:46.383578 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:46.383585 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:46.383660 (+ 75us) client_negotiation.cc:769] Sending connection context
0809 02:23:46.383761 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 02:23:46.383997 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":88,"thread_start_us":78,"threads_started":1}
I20260809 02:23:46.384179 3323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.375239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44990 (local address 127.11.93.190:36163)
0809 02:23:46.375417 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.375421 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.375474 (+ 53us) server_negotiation.cc:407] Connection header received
0809 02:23:46.375970 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.375972 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.375988 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.376064 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.376576 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.377408 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.378226 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.378543 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.378621 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.380636 (+ 2015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:46.380643 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:46.380644 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:46.380649 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:46.382373 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.382837 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.382839 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.382840 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.382925 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.383267 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.383268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.383268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.383503 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:46.383571 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:46.383803 (+ 232us) server_negotiation.cc:299] Negotiation successful
0809 02:23:46.383926 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":106,"threads_started":1}
I20260809 02:23:46.385305 3320 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:23:46.385674 3322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.385545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:32801 (local address 127.0.0.1:52336)
0809 02:23:46.385598 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.385642 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.189:32801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260809 02:23:46.385805 3266 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.93.189:32801: connect: Connection refused (error 111)
I20260809 02:23:46.386219 3322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.386128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:32801 (local address 127.0.0.1:52342)
0809 02:23:46.386174 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.386197 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.189:32801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260809 02:23:46.386328 3320 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.189:32801: Network error: Client connection negotiation failed: client connection to 127.11.93.189:32801: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.11.93.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.189.keytab.
Entry for principal kudu/127.11.93.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.189.keytab.
I20260809 02:23:46.409789 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.189:32801
--webserver_interface=127.11.93.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.189.keytab
--principal=kudu/127.11.93.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:45431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:36163,127.11.93.189:32801,127.11.93.188:43755
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:23:46.435562 3320 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } attempt: 1
I20260809 02:23:46.436175 3322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.436013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:32801 (local address 127.0.0.1:52350)
0809 02:23:46.436093 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.436139 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.189:32801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 02:23:46.436548 3322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.436459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:32801 (local address 127.0.0.1:52362)
0809 02:23:46.436501 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.436529 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.189:32801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260809 02:23:46.436695 3320 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.189:32801: Network error: Client connection negotiation failed: client connection to 127.11.93.189:32801: connect: Connection refused (error 111)
W20260809 02:23:46.491962 3327 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 02:23:46.492172 3327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:46.492188 3327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:46.492208 3327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:46.493356 3327 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:46.493396 3327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:46.493412 3327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:46.493459 3327 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:46.493486 3327 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:46.495029 3327 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:45431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:36163,127.11.93.189:32801,127.11.93.188:43755
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.189.keytab
--principal=kudu/127.11.93.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.189:32801
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.93.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3327
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:46.495278 3327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:46.495505 3327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:46.500379 3332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:46.500371 3335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:46.500371 3333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:46.500546 3327 server_base.cc:1034] running on GCE node
I20260809 02:23:46.500860 3327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:46.501150 3327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:46.502342 3327 hybrid_clock.cc:648] HybridClock initialized: now 1786242226502332 us; error 37 us; skew 500 ppm
Aug 09 02:23:46 dist-test-slave-w206 krb5kdc[3235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242226, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:46.504877 3320 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } attempt: 2
I20260809 02:23:46.505084 3327 init.cc:377] Logged in from keytab as kudu/127.11.93.189@KRBTEST.COM (short username kudu)
I20260809 02:23:46.505270 3322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.505138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:32801 (local address 127.0.0.1:52374)
0809 02:23:46.505199 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.505231 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.189:32801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 02:23:46.505700 3322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.505606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:32801 (local address 127.0.0.1:52376)
0809 02:23:46.505656 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.505682 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.189:32801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 02:23:46.505774 3327 webserver.cc:460] Webserver started at http://127.11.93.189:40253/ using document root <none> and password file <none>
W20260809 02:23:46.505824 3320 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.189:32801: Network error: Client connection negotiation failed: client connection to 127.11.93.189:32801: connect: Connection refused (error 111)
I20260809 02:23:46.506003 3327 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:46.506053 3327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:46.506150 3327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:46.507302 3327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-1/data/instance:
uuid: "513aa02d6a024134bcac3fb77f019c58"
format_stamp: "Formatted at 2026-08-09 02:23:46 on dist-test-slave-w206"
server_key: "6070563ac57c3fd10b52550447bd98c2"
server_key_iv: "b8fdb14f7b4b5c1c8816ac5b241fb281"
server_key_version: "encryptionkey@0"
I20260809 02:23:46.507642 3327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-1/wal/instance:
uuid: "513aa02d6a024134bcac3fb77f019c58"
format_stamp: "Formatted at 2026-08-09 02:23:46 on dist-test-slave-w206"
server_key: "6070563ac57c3fd10b52550447bd98c2"
server_key_iv: "b8fdb14f7b4b5c1c8816ac5b241fb281"
server_key_version: "encryptionkey@0"
I20260809 02:23:46.508999 3327 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260809 02:23:46.509743 3343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:46.509933 3327 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:46.510040 3327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-1/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-1/wal
uuid: "513aa02d6a024134bcac3fb77f019c58"
format_stamp: "Formatted at 2026-08-09 02:23:46 on dist-test-slave-w206"
server_key: "6070563ac57c3fd10b52550447bd98c2"
server_key_iv: "b8fdb14f7b4b5c1c8816ac5b241fb281"
server_key_version: "encryptionkey@0"
I20260809 02:23:46.510133 3327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:46.539310 3327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:46.541416 3327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:46.541592 3327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:46.546147 3327 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.189:32801
I20260809 02:23:46.546185 3396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.189:32801 every 8 connection(s)
I20260809 02:23:46.546559 3327 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-1/data/info.pb
I20260809 02:23:46.547544 3397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:46.549126 3397 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.190" port: 36163 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:23:46 dist-test-slave-w206 krb5kdc[3235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242226, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.189@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:23:46.555142 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 3327
I20260809 02:23:46.555259 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-1/wal/instance
I20260809 02:23:46.555469 11638 external_mini_cluster.cc:1428] Setting key 4a5a7c10ef5615fb21787f2e6d97b2e8
I20260809 02:23:46.558497 3323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.549968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45000 (local address 127.11.93.190:36163)
0809 02:23:46.550035 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.550037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.550250 (+ 213us) server_negotiation.cc:407] Connection header received
0809 02:23:46.550746 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.550748 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.550763 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.550831 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.551520 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.552015 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.552944 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.553152 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.553257 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.555378 (+ 2121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:46.555380 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:46.555381 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:46.555389 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:46.556999 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.557511 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.557512 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.557513 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.557581 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.557848 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.557849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.557850 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.557968 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:46.558047 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:46.558312 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 02:23:46.558399 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:23:46.558696 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.549902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:36163 (local address 127.0.0.1:45000)
0809 02:23:46.550110 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.550154 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:46.550621 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:46.550904 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:46.550908 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:46.551225 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:46.551428 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:46.551432 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.552095 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.552096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:46.552858 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:46.552860 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.553277 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.553278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:46.553390 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.553835 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:46.553843 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:46.555259 (+ 1416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:46.557083 (+ 1824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:46.557090 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:46.557092 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:46.557398 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:46.557654 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:46.557655 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:46.557656 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:46.557769 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:46.558039 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:46.558046 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:46.558183 (+ 137us) client_negotiation.cc:769] Sending connection context
0809 02:23:46.558289 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 02:23:46.558462 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":135,"threads_started":1}
I20260809 02:23:46.559223 3397 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:23:46 dist-test-slave-w206 krb5kdc[3235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242226, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.189@KRBTEST.COM for kudu/127.11.93.189@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.93.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.93.188@KRBTEST.COM" created.
I20260809 02:23:46.567493 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.559480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:32801 (local address 127.0.0.1:52386)
0809 02:23:46.559531 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.559542 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:46.559583 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:46.559808 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:46.559809 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:46.559959 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:46.560020 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:46.560022 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.561404 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.561405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:46.561949 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:46.561951 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.562614 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.562615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:46.562686 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.563195 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:46.563205 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:46.564457 (+ 1252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:46.566257 (+ 1800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:46.566258 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:46.566259 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:46.566449 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:46.566699 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:46.566700 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:46.566700 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:46.566793 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:46.567163 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:46.567164 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:46.567200 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 02:23:46.567258 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 02:23:46.567376 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 02:23:46.567574 3401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.559520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52386 (local address 127.11.93.189:32801)
0809 02:23:46.559668 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.559672 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.559692 (+ 20us) server_negotiation.cc:407] Connection header received
0809 02:23:46.559712 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.559718 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.559729 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.559809 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.560122 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.561291 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.562035 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.562528 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.562605 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.564542 (+ 1937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:46.564549 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:46.564549 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:46.564555 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:46.566084 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.566546 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.566549 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.566549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.566606 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.566876 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.566877 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.566878 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.567091 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:46.567179 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:46.567293 (+ 114us) server_negotiation.cc:299] Negotiation successful
0809 02:23:46.567443 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":121,"thread_start_us":74,"threads_started":1}
I20260809 02:23:46.568379 3397 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:23:46.568709 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.568595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43755 (local address 127.0.0.1:38098)
0809 02:23:46.568641 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.568689 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260809 02:23:46.568830 3347 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43755: connect: Connection refused (error 111)
I20260809 02:23:46.569316 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.569204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43755 (local address 127.0.0.1:38104)
0809 02:23:46.569251 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.569286 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 02:23:46.569473 3397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.188:43755: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43755: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.93.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.188.keytab.
Entry for principal kudu/127.11.93.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.188.keytab.
I20260809 02:23:46.582872 11638 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
/tmp/dist-test-taskWEWZ6r/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.188:43755
--webserver_interface=127.11.93.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.188.keytab
--principal=kudu/127.11.93.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.93.148:45431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.93.190:36163,127.11.93.189:32801,127.11.93.188:43755
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:23:46.596982 3320 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } attempt: 3
Aug 09 02:23:46 dist-test-slave-w206 krb5kdc[3235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242226, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for kudu/127.11.93.189@KRBTEST.COM
I20260809 02:23:46.604367 3401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.597428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52402 (local address 127.11.93.189:32801)
0809 02:23:46.597494 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.597496 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.597507 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:23:46.597560 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.597561 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.597575 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.597645 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.597986 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.598498 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.599289 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.599563 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.599687 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.601606 (+ 1919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:46.601607 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:46.601607 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:46.601615 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:46.603142 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.603552 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.603553 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.603554 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.603617 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.603821 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.603822 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.603822 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.603944 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:46.604017 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:46.604178 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 02:23:46.604263 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:23:46.604367 3322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.597356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:32801 (local address 127.0.0.1:52402)
0809 02:23:46.597408 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.597426 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:46.597493 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:46.597650 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:46.597651 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:46.597831 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:46.597899 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:46.597901 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.598588 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.598590 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:46.599203 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:46.599205 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.599683 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.599685 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:46.599772 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.600271 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:46.600276 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:46.601507 (+ 1231us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:46.603284 (+ 1777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:46.603286 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:46.603286 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:46.603471 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:46.603688 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:46.603689 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:46.603689 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:46.603756 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:46.604019 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:46.604021 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:46.604071 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 02:23:46.604154 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 02:23:46.604268 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260809 02:23:46.604995 3320 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:23:46.605350 3322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.605262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43755 (local address 127.0.0.1:38120)
0809 02:23:46.605298 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.605329 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260809 02:23:46.605681 3322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.605588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43755 (local address 127.0.0.1:38136)
0809 02:23:46.605633 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.605656 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260809 02:23:46.605777 3320 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.188:43755: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43755: connect: Connection refused (error 111)
I20260809 02:23:46.618696 3397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } attempt: 1
I20260809 02:23:46.619226 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.619100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43755 (local address 127.0.0.1:38140)
0809 02:23:46.619156 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.619198 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 02:23:46.619586 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.619491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43755 (local address 127.0.0.1:38150)
0809 02:23:46.619535 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.619560 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260809 02:23:46.619671 3397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.188:43755: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43755: connect: Connection refused (error 111)
I20260809 02:23:46.636925 3320 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } attempt: 1
I20260809 02:23:46.637463 3322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.637299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43755 (local address 127.0.0.1:38158)
0809 02:23:46.637363 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.637422 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 02:23:46.638270 3322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.638156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43755 (local address 127.0.0.1:38166)
0809 02:23:46.638207 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.638234 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 02:23:46.638357 3320 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.188:43755: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43755: connect: Connection refused (error 111)
W20260809 02:23:46.667891 3404 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 02:23:46.668138 3404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:23:46.668169 3404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:23:46.668221 3404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:23:46.669334 3404 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:23:46.669399 3404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:23:46.669422 3404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:23:46.669445 3404 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:23:46.669476 3404 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:23:46.671099 3404 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.93.148:45431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.93.190:36163,127.11.93.189:32801,127.11.93.188:43755
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/krb5kdc/kudu_127.11.93.188.keytab
--principal=kudu/127.11.93.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.93.188:43755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.93.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3404
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 01:32:21 UTC on ccycloud.quasar-japptc.root.comops.site
build id 4575764
I20260809 02:23:46.671376 3404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:23:46.671610 3404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:23:46.676426 3409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:46.676453 3413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:23:46.676447 3410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:23:46.676633 3404 server_base.cc:1034] running on GCE node
I20260809 02:23:46.676893 3404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:23:46.677205 3404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:23:46.678352 3404 hybrid_clock.cc:648] HybridClock initialized: now 1786242226678322 us; error 44 us; skew 500 ppm
Aug 09 02:23:46 dist-test-slave-w206 krb5kdc[3235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242226, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:23:46.681053 3404 init.cc:377] Logged in from keytab as kudu/127.11.93.188@KRBTEST.COM (short username kudu)
I20260809 02:23:46.681525 3404 webserver.cc:460] Webserver started at http://127.11.93.188:39233/ using document root <none> and password file <none>
I20260809 02:23:46.681777 3404 fs_manager.cc:359] Metadata directory not provided
I20260809 02:23:46.681847 3404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:23:46.682013 3404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:23:46.683123 3404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-2/data/instance:
uuid: "b413d38abc3445f9a8f264231dc6aaba"
format_stamp: "Formatted at 2026-08-09 02:23:46 on dist-test-slave-w206"
server_key: "84af4d4f48887eabd327dbee009e0061"
server_key_iv: "938e3535e0bc20ac9784fb3e246d77f8"
server_key_version: "encryptionkey@0"
I20260809 02:23:46.683496 3404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-2/wal/instance:
uuid: "b413d38abc3445f9a8f264231dc6aaba"
format_stamp: "Formatted at 2026-08-09 02:23:46 on dist-test-slave-w206"
server_key: "84af4d4f48887eabd327dbee009e0061"
server_key_iv: "938e3535e0bc20ac9784fb3e246d77f8"
server_key_version: "encryptionkey@0"
I20260809 02:23:46.684945 3404 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 02:23:46.685734 3421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:23:46.686000 3404 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:23:46.686118 3404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-2/data,/tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-2/wal
uuid: "b413d38abc3445f9a8f264231dc6aaba"
format_stamp: "Formatted at 2026-08-09 02:23:46 on dist-test-slave-w206"
server_key: "84af4d4f48887eabd327dbee009e0061"
server_key_iv: "938e3535e0bc20ac9784fb3e246d77f8"
server_key_version: "encryptionkey@0"
I20260809 02:23:46.686203 3404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:23:46.687820 3397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } attempt: 2
I20260809 02:23:46.688228 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.688101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43755 (local address 127.0.0.1:38182)
0809 02:23:46.688163 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.688200 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 02:23:46.688570 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.688472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43755 (local address 127.0.0.1:38188)
0809 02:23:46.688519 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.688543 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260809 02:23:46.688658 3397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.93.188:43755: Network error: Client connection negotiation failed: client connection to 127.11.93.188:43755: connect: Connection refused (error 111)
I20260809 02:23:46.697353 3404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:23:46.699735 3404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:23:46.699918 3404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:23:46.704023 3404 rpc_server.cc:307] RPC server started. Bound to: 127.11.93.188:43755
I20260809 02:23:46.704066 3475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.93.188:43755 every 8 connection(s)
I20260809 02:23:46.704463 3404 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-2/data/info.pb
I20260809 02:23:46.705457 3476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:23:46.707139 3476 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.190" port: 36163 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:23:46.708146 11638 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu as pid 3404
I20260809 02:23:46.708257 11638 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskWEWZ6r/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786241951749734-11638-0/minicluster-data/master-2/wal/instance
I20260809 02:23:46.708506 11638 external_mini_cluster.cc:1428] Setting key ae85676562a25481f90df1c42ab42a4b
I20260809 02:23:46.713497 3320 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } attempt: 2
Aug 09 02:23:46 dist-test-slave-w206 krb5kdc[3235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242226, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.188@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
Aug 09 02:23:46 dist-test-slave-w206 krb5kdc[3235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242226, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.188@KRBTEST.COM
Aug 09 02:23:46 dist-test-slave-w206 krb5kdc[3235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242226, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.190@KRBTEST.COM for kudu/127.11.93.188@KRBTEST.COM
I20260809 02:23:46.718490 3323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.707822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45014 (local address 127.11.93.190:36163)
0809 02:23:46.707887 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.707890 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.708190 (+ 300us) server_negotiation.cc:407] Connection header received
0809 02:23:46.708878 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.708879 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.708892 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.708943 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.709773 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.710460 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.711773 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.712004 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.712078 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.715323 (+ 3245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:46.715324 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:46.715324 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:46.715331 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:46.717126 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.717581 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.717583 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.717583 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.717639 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.717889 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.717890 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.717890 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.718008 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:46.718080 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:46.718316 (+ 236us) server_negotiation.cc:299] Negotiation successful
0809 02:23:46.718402 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 02:23:46.718664 3478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.707784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.190:36163 (local address 127.0.0.1:45014)
0809 02:23:46.708034 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.708084 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:46.708743 (+ 659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:46.709011 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:46.709016 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:46.709425 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:46.709669 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:46.709676 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.710546 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.710547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:46.711684 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:46.711687 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.712108 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.712109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:46.712210 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.712844 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:46.712855 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:46.715196 (+ 2341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:46.717224 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:46.717232 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:46.717234 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:46.717492 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:46.717717 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:46.717718 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:46.717718 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:46.717817 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:46.718085 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:46.718092 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:46.718172 (+ 80us) client_negotiation.cc:769] Sending connection context
0809 02:23:46.718271 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 02:23:46.718422 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":114,"thread_start_us":84,"threads_started":1}
I20260809 02:23:46.719550 3480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.708922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38192 (local address 127.11.93.188:43755)
0809 02:23:46.709065 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.709069 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.709144 (+ 75us) server_negotiation.cc:407] Connection header received
0809 02:23:46.709182 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.709184 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.709202 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.709274 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.710011 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.711055 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.712000 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.712345 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.712431 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.715249 (+ 2818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:46.715257 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:46.715257 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:46.715265 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:46.717161 (+ 1896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.717547 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.717550 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.717551 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.717657 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.717880 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.717881 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.717881 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.718159 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:46.719107 (+ 948us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:46.719156 (+ 49us) server_negotiation.cc:299] Negotiation successful
0809 02:23:46.719239 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":89,"threads_started":1}
I20260809 02:23:46.719503 3476 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:23:46.722054 3322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.713757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43755 (local address 127.0.0.1:38196)
0809 02:23:46.713815 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.713826 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:46.713867 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:46.714100 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:46.714101 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:46.714306 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:46.714342 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:46.714344 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.715279 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.715280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:46.716086 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:46.716089 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.716624 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.716625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:46.716693 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.717101 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:46.717106 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:46.718610 (+ 1504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:46.720904 (+ 2294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:46.720905 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:46.720906 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:46.721095 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:46.721377 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:46.721378 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:46.721378 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:46.721447 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:46.721737 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:46.721737 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:46.721788 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 02:23:46.721864 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 02:23:46.721956 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 02:23:46.722128 3481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.713836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38196 (local address 127.11.93.188:43755)
0809 02:23:46.713976 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.713979 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.713986 (+ 7us) server_negotiation.cc:407] Connection header received
0809 02:23:46.714004 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.714004 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.714014 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.714079 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.714424 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.715165 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.716214 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.716535 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.716612 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.718680 (+ 2068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:46.718681 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:46.718682 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:46.718688 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:46.720677 (+ 1989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.721184 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.721185 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.721185 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.721290 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.721532 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.721533 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.721534 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.721655 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:46.721723 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:46.721920 (+ 197us) server_negotiation.cc:299] Negotiation successful
0809 02:23:46.721999 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":88,"threads_started":1}
Aug 09 02:23:46 dist-test-slave-w206 krb5kdc[3235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242226, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.188@KRBTEST.COM for kudu/127.11.93.189@KRBTEST.COM
I20260809 02:23:46.724303 3320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b: Bootstrap starting.
I20260809 02:23:46.725132 3320 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:46.725441 3320 log.cc:824] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b: Log is configured to *not* fsync() on all Append() calls
Aug 09 02:23:46 dist-test-slave-w206 krb5kdc[3235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242226, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.190@KRBTEST.COM
I20260809 02:23:46.726241 3320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b: No bootstrap required, opened a new log
I20260809 02:23:46.727504 3478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.719988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.189:32801 (local address 127.0.0.1:52406)
0809 02:23:46.720048 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.720060 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:46.720106 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:46.720234 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:46.720234 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:46.720492 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:46.720530 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:46.720532 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.721463 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.721465 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:46.722171 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:46.722174 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.722688 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.722689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:46.722747 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.723205 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:46.723209 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:46.724528 (+ 1319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:46.726381 (+ 1853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:46.726382 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:46.726382 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:46.726613 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:46.726822 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:46.726823 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:46.726823 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:46.726874 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:46.727190 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:46.727193 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:46.727237 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 02:23:46.727303 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 02:23:46.727395 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 02:23:46.727653 3401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.720093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52406 (local address 127.11.93.189:32801)
0809 02:23:46.720138 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.720140 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.720148 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:23:46.720173 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.720174 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.720183 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.720232 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.720600 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.721363 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.722265 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.722578 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.722637 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.724613 (+ 1976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:46.724614 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:46.724615 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:46.724622 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:46.726304 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.726696 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.726697 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.726698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.726760 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.726954 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.726955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.726956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.727112 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:46.727439 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:46.727483 (+ 44us) server_negotiation.cc:299] Negotiation successful
0809 02:23:46.727554 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 02:23:46.728156 3476 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:23:46.728873 3320 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a690899dd0b4dde80eec84e767dc19b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 36163 } } peers { permanent_uuid: "513aa02d6a024134bcac3fb77f019c58" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } } peers { permanent_uuid: "b413d38abc3445f9a8f264231dc6aaba" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } }
I20260809 02:23:46.729020 3320 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a690899dd0b4dde80eec84e767dc19b, State: Initialized, Role: FOLLOWER
I20260809 02:23:46.729101 3320 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a690899dd0b4dde80eec84e767dc19b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 36163 } } peers { permanent_uuid: "513aa02d6a024134bcac3fb77f019c58" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } } peers { permanent_uuid: "b413d38abc3445f9a8f264231dc6aaba" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } }
I20260809 02:23:46.729228 3323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.720720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45020 (local address 127.11.93.190:36163)
0809 02:23:46.720754 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.720755 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.720798 (+ 43us) server_negotiation.cc:407] Connection header received
0809 02:23:46.720847 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.720848 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.720856 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.720904 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.721508 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.722173 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.723086 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.723326 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.723366 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.726189 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:46.726190 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:46.726191 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:46.726197 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:46.728050 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.728481 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.728482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.728483 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.728545 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.728735 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.728735 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.728736 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.728829 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:46.729028 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:46.729063 (+ 35us) server_negotiation.cc:299] Negotiation successful
0809 02:23:46.729131 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 02:23:46.729511 3320 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b [sys.catalog]: configured and running, proceeding with master startup.
W20260809 02:23:46.731309 3495 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:23:46.731366 3495 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:23:46.731617 3483 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a690899dd0b4dde80eec84e767dc19b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 36163 } } peers { permanent_uuid: "513aa02d6a024134bcac3fb77f019c58" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } } peers { permanent_uuid: "b413d38abc3445f9a8f264231dc6aaba" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } } }
I20260809 02:23:46.731698 3483 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b [sys.catalog]: This master's current role is: FOLLOWER
Aug 09 02:23:46 dist-test-slave-w206 krb5kdc[3235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242226, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.188@KRBTEST.COM for kudu/127.11.93.188@KRBTEST.COM
I20260809 02:23:46.732187 3248 master_runner.cc:186] Error getting master registration for 127.11.93.189:32801: OK, instance_id { permanent_uuid: "513aa02d6a024134bcac3fb77f019c58" instance_seqno: 1786242226544838 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 02:23:46.735469 3248 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 09 02:23:46 dist-test-slave-w206 krb5kdc[3235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242226, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.93.189@KRBTEST.COM
I20260809 02:23:46.736140 3478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.728404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43755 (local address 127.0.0.1:38204)
0809 02:23:46.728446 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.728455 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:46.728487 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:46.728766 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:46.728767 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:46.728907 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:46.728939 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:46.728941 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.729761 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.729762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:46.730542 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:46.730545 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.731102 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.731102 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:46.731157 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.731863 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:46.731869 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:46.733258 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:46.735093 (+ 1835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:46.735094 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:46.735094 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:46.735288 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:46.735489 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:46.735490 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:46.735490 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:46.735544 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:46.735806 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:46.735807 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:46.735846 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 02:23:46.735933 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 02:23:46.736032 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260809 02:23:46.736195 3481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.728465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38204 (local address 127.11.93.188:43755)
0809 02:23:46.728500 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.728502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.728509 (+ 7us) server_negotiation.cc:407] Connection header received
0809 02:23:46.728531 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.728531 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.728541 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.728598 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.729020 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.729667 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.730641 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.731019 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.731309 (+ 290us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.733373 (+ 2064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:46.733375 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:46.733375 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:46.733383 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:46.734962 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.735372 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.735372 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.735373 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.735424 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.735609 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.735609 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.735609 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.735723 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:46.735807 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:46.735965 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 02:23:46.736084 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":20}
I20260809 02:23:46.737717 3476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b413d38abc3445f9a8f264231dc6aaba: Bootstrap starting.
I20260809 02:23:46.738497 3476 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b413d38abc3445f9a8f264231dc6aaba: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:46.738811 3476 log.cc:824] T 00000000000000000000000000000000 P b413d38abc3445f9a8f264231dc6aaba: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:46.739629 3476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b413d38abc3445f9a8f264231dc6aaba: No bootstrap required, opened a new log
I20260809 02:23:46.739991 3401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.729780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52418 (local address 127.11.93.189:32801)
0809 02:23:46.729816 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.729818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.729856 (+ 38us) server_negotiation.cc:407] Connection header received
0809 02:23:46.729923 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.729924 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.729933 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.729979 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.730549 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.731240 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.732626 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.732914 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.733063 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.736809 (+ 3746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:46.736810 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:46.736810 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:46.736817 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:46.738623 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.739095 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.739096 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.739097 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.739162 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.739374 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.739376 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.739376 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.739505 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:46.739754 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:46.739811 (+ 57us) server_negotiation.cc:299] Negotiation successful
0809 02:23:46.739883 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 02:23:46.741496 11638 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:23:46.741830 3476 raft_consensus.cc:348] T 00000000000000000000000000000000 P b413d38abc3445f9a8f264231dc6aaba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a690899dd0b4dde80eec84e767dc19b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 36163 } } peers { permanent_uuid: "513aa02d6a024134bcac3fb77f019c58" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } } peers { permanent_uuid: "b413d38abc3445f9a8f264231dc6aaba" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } }
I20260809 02:23:46.741972 3476 raft_consensus.cc:729] T 00000000000000000000000000000000 P b413d38abc3445f9a8f264231dc6aaba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b413d38abc3445f9a8f264231dc6aaba, State: Initialized, Role: FOLLOWER
I20260809 02:23:46.742054 3476 consensus_queue.cc:260] T 00000000000000000000000000000000 P b413d38abc3445f9a8f264231dc6aaba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a690899dd0b4dde80eec84e767dc19b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 36163 } } peers { permanent_uuid: "513aa02d6a024134bcac3fb77f019c58" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } } peers { permanent_uuid: "b413d38abc3445f9a8f264231dc6aaba" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } }
I20260809 02:23:46.742417 3476 sys_catalog.cc:564] T 00000000000000000000000000000000 P b413d38abc3445f9a8f264231dc6aaba [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:46.742516 3290 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "6a690899dd0b4dde80eec84e767dc19b"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45020
I20260809 02:23:46.742539 3499 sys_catalog.cc:455] T 00000000000000000000000000000000 P b413d38abc3445f9a8f264231dc6aaba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a690899dd0b4dde80eec84e767dc19b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 36163 } } peers { permanent_uuid: "513aa02d6a024134bcac3fb77f019c58" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } } peers { permanent_uuid: "b413d38abc3445f9a8f264231dc6aaba" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } } }
I20260809 02:23:46.742650 3290 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 02:23:46.742657 3499 sys_catalog.cc:458] T 00000000000000000000000000000000 P b413d38abc3445f9a8f264231dc6aaba [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:23:46.742694 3290 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:46.743757 3290 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a690899dd0b4dde80eec84e767dc19b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 36163 } } peers { permanent_uuid: "513aa02d6a024134bcac3fb77f019c58" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } } peers { permanent_uuid: "b413d38abc3445f9a8f264231dc6aaba" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } }
I20260809 02:23:46.744029 3290 leader_election.cc:288] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b [CANDIDATE]: Term 1 election: Requested vote from peers 513aa02d6a024134bcac3fb77f019c58 (127.11.93.189:32801), b413d38abc3445f9a8f264231dc6aaba (127.11.93.188:43755)
I20260809 02:23:46.744536 3449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6a690899dd0b4dde80eec84e767dc19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b413d38abc3445f9a8f264231dc6aaba"
I20260809 02:23:46.744639 3449 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b413d38abc3445f9a8f264231dc6aaba [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:46.745472 3449 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b413d38abc3445f9a8f264231dc6aaba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a690899dd0b4dde80eec84e767dc19b in term 1.
I20260809 02:23:46.745911 3266 leader_election.cc:302] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a690899dd0b4dde80eec84e767dc19b, b413d38abc3445f9a8f264231dc6aaba; no voters:
I20260809 02:23:46.746040 3483 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:23:46.746229 3483 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b [term 1 LEADER]: Becoming Leader. State: Replica: 6a690899dd0b4dde80eec84e767dc19b, State: Running, Role: LEADER
I20260809 02:23:46.746325 3483 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a690899dd0b4dde80eec84e767dc19b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 36163 } } peers { permanent_uuid: "513aa02d6a024134bcac3fb77f019c58" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } } peers { permanent_uuid: "b413d38abc3445f9a8f264231dc6aaba" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } }
I20260809 02:23:46.746740 3516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a690899dd0b4dde80eec84e767dc19b. Latest consensus state: current_term: 1 leader_uuid: "6a690899dd0b4dde80eec84e767dc19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a690899dd0b4dde80eec84e767dc19b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 36163 } } peers { permanent_uuid: "513aa02d6a024134bcac3fb77f019c58" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } } peers { permanent_uuid: "b413d38abc3445f9a8f264231dc6aaba" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } } }
I20260809 02:23:46.746897 3516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b [sys.catalog]: This master's current role is: LEADER
W20260809 02:23:46.747236 3510 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b413d38abc3445f9a8f264231dc6aaba: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:23:46.747342 3510 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:23:46.747691 3519 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:23:46.747982 3519 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:23:46.745898 3404 master_runner.cc:186] Error getting master registration for 127.11.93.189:32801: OK, instance_id { permanent_uuid: "513aa02d6a024134bcac3fb77f019c58" instance_seqno: 1786242226544838 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 02:23:46.748193 3404 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:23:46.749744 3449 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b413d38abc3445f9a8f264231dc6aaba [term 1 FOLLOWER]: Refusing update from remote peer 6a690899dd0b4dde80eec84e767dc19b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:46.750093 3516 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b413d38abc3445f9a8f264231dc6aaba" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:46.751461 3499 sys_catalog.cc:455] T 00000000000000000000000000000000 P b413d38abc3445f9a8f264231dc6aaba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a690899dd0b4dde80eec84e767dc19b. Latest consensus state: current_term: 1 leader_uuid: "6a690899dd0b4dde80eec84e767dc19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a690899dd0b4dde80eec84e767dc19b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 36163 } } peers { permanent_uuid: "513aa02d6a024134bcac3fb77f019c58" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } } peers { permanent_uuid: "b413d38abc3445f9a8f264231dc6aaba" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } } }
I20260809 02:23:46.751559 3499 sys_catalog.cc:458] T 00000000000000000000000000000000 P b413d38abc3445f9a8f264231dc6aaba [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:23:46.752873 3516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6a690899dd0b4dde80eec84e767dc19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a690899dd0b4dde80eec84e767dc19b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 36163 } } peers { permanent_uuid: "513aa02d6a024134bcac3fb77f019c58" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } } peers { permanent_uuid: "b413d38abc3445f9a8f264231dc6aaba" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } } }
I20260809 02:23:46.752965 3516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:46.753489 3499 sys_catalog.cc:455] T 00000000000000000000000000000000 P b413d38abc3445f9a8f264231dc6aaba [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6a690899dd0b4dde80eec84e767dc19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a690899dd0b4dde80eec84e767dc19b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 36163 } } peers { permanent_uuid: "513aa02d6a024134bcac3fb77f019c58" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } } peers { permanent_uuid: "b413d38abc3445f9a8f264231dc6aaba" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } } }
I20260809 02:23:46.753571 3499 sys_catalog.cc:458] T 00000000000000000000000000000000 P b413d38abc3445f9a8f264231dc6aaba [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:23:46.753849 3523 mvcc.cc:205] Tried to move back new op lower bound from 7316448160764465152 to 7316448160753647616. Current Snapshot: MvccSnapshot[applied={T|T < 7316448160764465152}]
I20260809 02:23:46.754428 3525 mvcc.cc:205] Tried to move back new op lower bound from 7316448160764465152 to 7316448160753647616. Current Snapshot: MvccSnapshot[applied={T|T < 7316448160764465152}]
I20260809 02:23:46.757647 3401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.747691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52422 (local address 127.11.93.189:32801)
0809 02:23:46.747737 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.747739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.748767 (+ 1028us) server_negotiation.cc:407] Connection header received
0809 02:23:46.748879 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.748880 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.748893 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.748923 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.749720 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.750414 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.751439 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.751738 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.751786 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.754186 (+ 2400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:46.754188 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:46.754188 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:46.754206 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:46.756025 (+ 1819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.756599 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.756600 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.756600 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.756674 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.756952 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.756953 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.756953 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.757086 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:46.757156 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:46.757467 (+ 311us) server_negotiation.cc:299] Negotiation successful
0809 02:23:46.757545 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 02:23:46.758662 3519 catalog_manager.cc:1347] Generated new cluster ID: 17dd5ec9c9564529a55145823588074e
I20260809 02:23:46.758713 3519 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:23:46.771870 3481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.748229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38218 (local address 127.11.93.188:43755)
0809 02:23:46.748338 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.748340 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.752138 (+ 3798us) server_negotiation.cc:407] Connection header received
0809 02:23:46.752263 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.752264 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.752275 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.752318 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.763769 (+ 11451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.764507 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.765497 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.765997 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.766379 (+ 382us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.767745 (+ 1366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:46.767746 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:46.767746 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:46.767751 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:46.769966 (+ 2215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.770413 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.770414 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.770414 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.770518 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.770752 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.770753 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.770753 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.770958 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:46.771531 (+ 573us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:46.771593 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 02:23:46.771695 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260809 02:23:46.772156 3323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.749121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45026 (local address 127.11.93.190:36163)
0809 02:23:46.749166 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.749168 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.754680 (+ 5512us) server_negotiation.cc:407] Connection header received
0809 02:23:46.754780 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.754781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.754791 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.754834 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.755542 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.756280 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.757295 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.757573 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.757613 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.769195 (+ 11582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:46.769197 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:46.769197 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:46.769205 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:46.770895 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.771329 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.771330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.771331 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.771388 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.771587 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.771588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.771588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.771718 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:46.771796 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:46.771983 (+ 187us) server_negotiation.cc:299] Negotiation successful
0809 02:23:46.772060 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 02:23:46.779778 3397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } attempt: 3
I20260809 02:23:46.782594 3519 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:23:46.783943 3519 catalog_manager.cc:1504] Loading token signing keys...
Aug 09 02:23:46 dist-test-slave-w206 krb5kdc[3235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242226, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.93.189@KRBTEST.COM for kudu/127.11.93.188@KRBTEST.COM
I20260809 02:23:46.789819 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.780094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.93.188:43755 (local address 127.0.0.1:38226)
0809 02:23:46.780147 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0809 02:23:46.780157 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 02:23:46.780194 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:23:46.780441 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:23:46.780442 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:23:46.780614 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:23:46.780661 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:46.780663 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.782434 (+ 1771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.782435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:46.783216 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:23:46.783218 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.783744 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.783745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:23:46.783797 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.784247 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:23:46.784252 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:23:46.785751 (+ 1499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:23:46.788569 (+ 2818us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:46.788570 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:46.788570 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:46.788762 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:46.789053 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:23:46.789054 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:23:46.789054 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:23:46.789119 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:23:46.789539 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:23:46.789540 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:23:46.789593 (+ 53us) client_negotiation.cc:769] Sending connection context
0809 02:23:46.789635 (+ 42us) client_negotiation.cc:240] Negotiation successful
0809 02:23:46.789722 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 02:23:46.790684 3481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.780145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38226 (local address 127.11.93.188:43755)
0809 02:23:46.780205 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.780207 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.780266 (+ 59us) server_negotiation.cc:407] Connection header received
0809 02:23:46.780285 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.780285 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.780331 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.781654 (+ 1323us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.781685 (+ 31us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.782335 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.783381 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.783657 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.783953 (+ 296us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.785850 (+ 1897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:23:46.785852 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:23:46.785852 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:23:46.785858 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:23:46.788448 (+ 2590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.788849 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.788850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.788851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.788966 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:23:46.789193 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:23:46.789193 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:23:46.789193 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:23:46.789445 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:23:46.790353 (+ 908us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:46.790421 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 02:23:46.790542 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 02:23:46.792464 3397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 513aa02d6a024134bcac3fb77f019c58: Bootstrap starting.
I20260809 02:23:46.793219 3397 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 513aa02d6a024134bcac3fb77f019c58: Neither blocks nor log segments found. Creating new log.
I20260809 02:23:46.793548 3397 log.cc:824] T 00000000000000000000000000000000 P 513aa02d6a024134bcac3fb77f019c58: Log is configured to *not* fsync() on all Append() calls
I20260809 02:23:46.795167 3397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 513aa02d6a024134bcac3fb77f019c58: No bootstrap required, opened a new log
I20260809 02:23:46.795122 3519 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b: Generated new TSK 0
I20260809 02:23:46.795651 3519 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:23:46.797183 3397 raft_consensus.cc:348] T 00000000000000000000000000000000 P 513aa02d6a024134bcac3fb77f019c58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a690899dd0b4dde80eec84e767dc19b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 36163 } } peers { permanent_uuid: "513aa02d6a024134bcac3fb77f019c58" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } } peers { permanent_uuid: "b413d38abc3445f9a8f264231dc6aaba" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } }
I20260809 02:23:46.797322 3397 raft_consensus.cc:729] T 00000000000000000000000000000000 P 513aa02d6a024134bcac3fb77f019c58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 513aa02d6a024134bcac3fb77f019c58, State: Initialized, Role: FOLLOWER
I20260809 02:23:46.797405 3397 consensus_queue.cc:260] T 00000000000000000000000000000000 P 513aa02d6a024134bcac3fb77f019c58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a690899dd0b4dde80eec84e767dc19b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 36163 } } peers { permanent_uuid: "513aa02d6a024134bcac3fb77f019c58" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } } peers { permanent_uuid: "b413d38abc3445f9a8f264231dc6aaba" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } }
I20260809 02:23:46.797746 3397 sys_catalog.cc:564] T 00000000000000000000000000000000 P 513aa02d6a024134bcac3fb77f019c58 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:23:46.797863 3370 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 513aa02d6a024134bcac3fb77f019c58 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:23:46.798758 3370 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 513aa02d6a024134bcac3fb77f019c58 [term 1 FOLLOWER]: Refusing update from remote peer 6a690899dd0b4dde80eec84e767dc19b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:23:46.797819 3371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6a690899dd0b4dde80eec84e767dc19b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "513aa02d6a024134bcac3fb77f019c58"
I20260809 02:23:46.799710 3371 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 513aa02d6a024134bcac3fb77f019c58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a690899dd0b4dde80eec84e767dc19b in term 1.
I20260809 02:23:46.799964 3483 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b [LEADER]: Connected to new peer: Peer: permanent_uuid: "513aa02d6a024134bcac3fb77f019c58" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:23:46.802254 3543 mvcc.cc:205] Tried to move back new op lower bound from 7316448160948289536 to 7316448160753647616. Current Snapshot: MvccSnapshot[applied={T|T < 7316448160764465152}]
I20260809 02:23:46.803061 3545 sys_catalog.cc:455] T 00000000000000000000000000000000 P 513aa02d6a024134bcac3fb77f019c58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a690899dd0b4dde80eec84e767dc19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a690899dd0b4dde80eec84e767dc19b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 36163 } } peers { permanent_uuid: "513aa02d6a024134bcac3fb77f019c58" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } } peers { permanent_uuid: "b413d38abc3445f9a8f264231dc6aaba" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } } }
I20260809 02:23:46.803205 3545 sys_catalog.cc:458] T 00000000000000000000000000000000 P 513aa02d6a024134bcac3fb77f019c58 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:23:46.803323 3545 sys_catalog.cc:455] T 00000000000000000000000000000000 P 513aa02d6a024134bcac3fb77f019c58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a690899dd0b4dde80eec84e767dc19b. Latest consensus state: current_term: 1 leader_uuid: "6a690899dd0b4dde80eec84e767dc19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a690899dd0b4dde80eec84e767dc19b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 36163 } } peers { permanent_uuid: "513aa02d6a024134bcac3fb77f019c58" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } } peers { permanent_uuid: "b413d38abc3445f9a8f264231dc6aaba" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } } }
I20260809 02:23:46.803437 3545 sys_catalog.cc:458] T 00000000000000000000000000000000 P 513aa02d6a024134bcac3fb77f019c58 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:23:46.803524 3545 sys_catalog.cc:455] T 00000000000000000000000000000000 P 513aa02d6a024134bcac3fb77f019c58 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6a690899dd0b4dde80eec84e767dc19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a690899dd0b4dde80eec84e767dc19b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 36163 } } peers { permanent_uuid: "513aa02d6a024134bcac3fb77f019c58" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } } peers { permanent_uuid: "b413d38abc3445f9a8f264231dc6aaba" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } } }
I20260809 02:23:46.803654 3545 sys_catalog.cc:458] T 00000000000000000000000000000000 P 513aa02d6a024134bcac3fb77f019c58 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:23:46.807595 3541 catalog_manager.cc:1259] Loaded cluster ID: 17dd5ec9c9564529a55145823588074e
I20260809 02:23:46.807643 3541 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 513aa02d6a024134bcac3fb77f019c58: loading cluster ID for follower catalog manager: success
I20260809 02:23:46.808779 3541 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 513aa02d6a024134bcac3fb77f019c58: acquiring CA information for follower catalog manager: success
I20260809 02:23:46.809090 3541 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 513aa02d6a024134bcac3fb77f019c58: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 02:23:46.819275 3323 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:46.818310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45034 (local address 127.11.93.190:36163)
0809 02:23:46.818439 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.818441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.818590 (+ 149us) server_negotiation.cc:407] Connection header received
0809 02:23:46.818696 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.818697 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.818708 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.818739 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.819208 (+ 469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45034: BlockingRecv error: recv got EOF from 127.0.0.1:45034 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
W20260809 02:23:46.820026 3401 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:46.818351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52426 (local address 127.11.93.189:32801)
0809 02:23:46.818471 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.818473 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.819507 (+ 1034us) server_negotiation.cc:407] Connection header received
0809 02:23:46.819600 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.819601 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.819611 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.819641 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.819975 (+ 334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52426: BlockingRecv error: recv got EOF from 127.0.0.1:52426 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
W20260809 02:23:46.820757 3481 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:46.818390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38236 (local address 127.11.93.188:43755)
0809 02:23:46.818437 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.818440 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.820254 (+ 1814us) server_negotiation.cc:407] Connection header received
0809 02:23:46.820353 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.820354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.820365 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.820394 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.820698 (+ 304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38236: BlockingRecv error: recv got EOF from 127.0.0.1:38236 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 02:23:46.826712 3401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.823248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52428 (local address 127.11.93.189:32801)
0809 02:23:46.823282 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.823284 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.823479 (+ 195us) server_negotiation.cc:407] Connection header received
0809 02:23:46.823582 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.823583 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.823612 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.823655 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:46.823877 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.824634 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.825774 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.826075 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.826121 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.826349 (+ 228us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:46.826465 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:46.826513 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:46.826626 (+ 113us) server_negotiation.cc:299] Negotiation successful
0809 02:23:46.826644 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260809 02:23:46.830039 3481 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:46.829107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38240 (local address 127.11.93.188:43755)
0809 02:23:46.829147 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.829148 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.829392 (+ 244us) server_negotiation.cc:407] Connection header received
0809 02:23:46.829518 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.829519 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.829542 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.829579 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.829989 (+ 410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38240: BlockingRecv error: recv got EOF from 127.0.0.1:38240 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 02:23:46.835438 3401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.832244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52436 (local address 127.11.93.189:32801)
0809 02:23:46.832279 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.832280 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.832517 (+ 237us) server_negotiation.cc:407] Connection header received
0809 02:23:46.832609 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.832610 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.832619 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.832645 (+ 26us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:46.832823 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.833538 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.834636 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.834939 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.834999 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.835189 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:46.835221 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:46.835248 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:46.835348 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 02:23:46.835366 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260809 02:23:46.838485 3481 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:46.837690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38246 (local address 127.11.93.188:43755)
0809 02:23:46.837724 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.837726 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.837965 (+ 239us) server_negotiation.cc:407] Connection header received
0809 02:23:46.838060 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.838061 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.838073 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.838105 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.838435 (+ 330us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38246: BlockingRecv error: recv got EOF from 127.0.0.1:38246 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 02:23:46.844635 3401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.841494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52446 (local address 127.11.93.189:32801)
0809 02:23:46.841536 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.841538 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.841766 (+ 228us) server_negotiation.cc:407] Connection header received
0809 02:23:46.841872 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.841873 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.841882 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.841908 (+ 26us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:46.842057 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.842774 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.843885 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.844172 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.844209 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.844394 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:46.844424 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:46.844450 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:46.844550 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 02:23:46.844565 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
W20260809 02:23:46.847548 3481 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:46.846785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38256 (local address 127.11.93.188:43755)
0809 02:23:46.846832 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.846833 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.847042 (+ 209us) server_negotiation.cc:407] Connection header received
0809 02:23:46.847135 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.847136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.847146 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.847192 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.847500 (+ 308us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38256: BlockingRecv error: recv got EOF from 127.0.0.1:38256 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 02:23:46.855695 3401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.852513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52460 (local address 127.11.93.189:32801)
0809 02:23:46.852547 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.852549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.852774 (+ 225us) server_negotiation.cc:407] Connection header received
0809 02:23:46.852882 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.852883 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.852892 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.852919 (+ 27us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:46.853073 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.853790 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.854890 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.855207 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.855247 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.855445 (+ 198us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:46.855476 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:46.855503 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:46.855604 (+ 101us) server_negotiation.cc:299] Negotiation successful
0809 02:23:46.855623 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260809 02:23:46.858554 3481 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:46.857832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38260 (local address 127.11.93.188:43755)
0809 02:23:46.857868 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.857869 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.858063 (+ 194us) server_negotiation.cc:407] Connection header received
0809 02:23:46.858153 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.858154 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.858164 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.858194 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.858505 (+ 311us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38260: BlockingRecv error: recv got EOF from 127.0.0.1:38260 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 02:23:46.871047 3401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.867689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52468 (local address 127.11.93.189:32801)
0809 02:23:46.867728 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.867730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.867992 (+ 262us) server_negotiation.cc:407] Connection header received
0809 02:23:46.868089 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.868091 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.868101 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.868130 (+ 29us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:46.868304 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.869071 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.870175 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.870469 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.870507 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.870696 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:46.870728 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:46.870754 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:46.870871 (+ 117us) server_negotiation.cc:299] Negotiation successful
0809 02:23:46.870890 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 02:23:46.874310 3481 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:46.873534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38274 (local address 127.11.93.188:43755)
0809 02:23:46.873577 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.873579 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.873766 (+ 187us) server_negotiation.cc:407] Connection header received
0809 02:23:46.873880 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.873881 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.873892 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.873921 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.874252 (+ 331us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38274: BlockingRecv error: recv got EOF from 127.0.0.1:38274 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 02:23:46.895027 3401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.891648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52484 (local address 127.11.93.189:32801)
0809 02:23:46.891688 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.891690 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.891984 (+ 294us) server_negotiation.cc:407] Connection header received
0809 02:23:46.892085 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.892086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.892098 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.892125 (+ 27us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:46.892324 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.893064 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.894190 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.894475 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.894516 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.894713 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:46.894746 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:46.894773 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:46.894894 (+ 121us) server_negotiation.cc:299] Negotiation successful
0809 02:23:46.894913 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 02:23:46.898284 3481 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:46.897412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38288 (local address 127.11.93.188:43755)
0809 02:23:46.897453 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.897455 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.897678 (+ 223us) server_negotiation.cc:407] Connection header received
0809 02:23:46.897781 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.897782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.897793 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.897861 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.898230 (+ 369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38288: BlockingRecv error: recv got EOF from 127.0.0.1:38288 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 02:23:46.935204 3401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:46.931717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52492 (local address 127.11.93.189:32801)
0809 02:23:46.931763 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.931766 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.932083 (+ 317us) server_negotiation.cc:407] Connection header received
0809 02:23:46.932194 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.932196 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.932209 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.932241 (+ 32us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:46.932433 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.933194 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.934342 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:46.934640 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:46.934688 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:46.934902 (+ 214us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:46.934938 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:46.934965 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:46.935096 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 02:23:46.935115 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260809 02:23:46.938544 3481 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:46.937685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38304 (local address 127.11.93.188:43755)
0809 02:23:46.937728 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:46.937730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:46.937963 (+ 233us) server_negotiation.cc:407] Connection header received
0809 02:23:46.938062 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:46.938064 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:46.938077 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:46.938112 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:46.938485 (+ 373us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38304: BlockingRecv error: recv got EOF from 127.0.0.1:38304 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 02:23:47.006155 3401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:47.003920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52502 (local address 127.11.93.189:32801)
0809 02:23:47.004035 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:47.004037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:47.004100 (+ 63us) server_negotiation.cc:407] Connection header received
0809 02:23:47.004164 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:47.004165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:47.004176 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:47.004219 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:47.004355 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:47.004828 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:47.005551 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:47.005724 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:47.005773 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:47.005899 (+ 126us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:47.005925 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:47.005962 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:47.006022 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 02:23:47.006037 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260809 02:23:47.008913 3481 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:47.008250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38308 (local address 127.11.93.188:43755)
0809 02:23:47.008327 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:47.008329 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:47.008340 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:23:47.008410 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:47.008411 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:47.008424 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:47.008491 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:47.008851 (+ 360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38308: BlockingRecv error: recv got EOF from 127.0.0.1:38308 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 02:23:47.140628 3401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:47.138314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52512 (local address 127.11.93.189:32801)
0809 02:23:47.138392 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:47.138394 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:47.138405 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:23:47.138481 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:47.138482 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:47.138492 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:47.138532 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:47.138768 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:47.139270 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:47.140036 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:47.140235 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:47.140300 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:47.140436 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:47.140463 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:47.140502 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:47.140553 (+ 51us) server_negotiation.cc:299] Negotiation successful
0809 02:23:47.140569 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
W20260809 02:23:47.142935 3481 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:47.142374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38316 (local address 127.11.93.188:43755)
0809 02:23:47.142493 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:47.142496 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:47.142506 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:23:47.142578 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:47.142579 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:47.142588 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:47.142630 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:47.142894 (+ 264us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38316: BlockingRecv error: recv got EOF from 127.0.0.1:38316 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:23:47.402446 3401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:47.400263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52514 (local address 127.11.93.189:32801)
0809 02:23:47.400341 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:47.400347 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:47.400357 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:23:47.400386 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:47.400387 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:47.400395 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:47.400455 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:47.400631 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:47.401115 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:47.401861 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:47.402044 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:47.402099 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:47.402233 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:47.402261 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:47.402304 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:47.402370 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 02:23:47.402385 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260809 02:23:47.404749 3481 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:23:47.404194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38322 (local address 127.11.93.188:43755)
0809 02:23:47.404251 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:47.404253 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:47.404262 (+ 9us) server_negotiation.cc:407] Connection header received
0809 02:23:47.404326 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:47.404326 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:47.404337 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:47.404382 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:23:47.404702 (+ 320us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38322: BlockingRecv error: recv got EOF from 127.0.0.1:38322 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 02:23:47.410377 3483 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6a690899dd0b4dde80eec84e767dc19b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a690899dd0b4dde80eec84e767dc19b" member_type: VOTER last_known_addr { host: "127.11.93.190" port: 36163 } } peers { permanent_uuid: "513aa02d6a024134bcac3fb77f019c58" member_type: VOTER last_known_addr { host: "127.11.93.189" port: 32801 } } peers { permanent_uuid: "b413d38abc3445f9a8f264231dc6aaba" member_type: VOTER last_known_addr { host: "127.11.93.188" port: 43755 } } }
I20260809 02:23:47.410519 3483 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a690899dd0b4dde80eec84e767dc19b [sys.catalog]: This master's current role is: LEADER
I20260809 02:23:47.747776 3510 catalog_manager.cc:1259] Loaded cluster ID: 17dd5ec9c9564529a55145823588074e
I20260809 02:23:47.747857 3510 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b413d38abc3445f9a8f264231dc6aaba: loading cluster ID for follower catalog manager: success
I20260809 02:23:47.748725 3510 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b413d38abc3445f9a8f264231dc6aaba: acquiring CA information for follower catalog manager: success
I20260809 02:23:47.749128 3510 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b413d38abc3445f9a8f264231dc6aaba: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:23:47.920179 3673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:47.917894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52520 (local address 127.11.93.189:32801)
0809 02:23:47.917997 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:47.917999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:47.918009 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:23:47.918065 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:47.918066 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:47.918077 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:47.918147 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:47.918266 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:47.918747 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:47.919553 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:47.919743 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:47.919811 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:47.919927 (+ 116us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:47.919954 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:47.919993 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:47.920040 (+ 47us) server_negotiation.cc:299] Negotiation successful
0809 02:23:47.920058 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":58,"threads_started":1}
I20260809 02:23:47.924382 3679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:47.921888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38336 (local address 127.11.93.188:43755)
0809 02:23:47.922008 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:47.922010 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:47.922018 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:23:47.922057 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:47.922058 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:47.922119 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:47.922202 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:47.922320 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:47.922782 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:47.923578 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:47.923794 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:47.923876 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:47.924043 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:47.924152 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:47.924240 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:47.924262 (+ 22us) server_negotiation.cc:299] Negotiation successful
0809 02:23:47.924283 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":53,"threads_started":1}
I20260809 02:23:47.928959 3679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:47.926155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38346 (local address 127.11.93.188:43755)
0809 02:23:47.926188 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:47.926189 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:47.926413 (+ 224us) server_negotiation.cc:407] Connection header received
0809 02:23:47.926474 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:47.926475 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:47.926484 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:47.926538 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:47.926635 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:47.927164 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:47.927924 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:47.928125 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:47.928198 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:47.928664 (+ 466us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:47.928714 (+ 50us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:47.928767 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:47.928869 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 02:23:47.928891 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 02:23:47.929227 3673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:47.925994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52526 (local address 127.11.93.189:32801)
0809 02:23:47.926042 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:47.926044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:47.926157 (+ 113us) server_negotiation.cc:407] Connection header received
0809 02:23:47.926253 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:47.926254 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:47.926265 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:47.926308 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:47.926518 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:47.927244 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:47.928386 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:47.928591 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:47.928638 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:47.928824 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:47.928862 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:47.928931 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:47.929123 (+ 192us) server_negotiation.cc:299] Negotiation successful
0809 02:23:47.929149 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 02:23:47.929368 3686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:23:47.926011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45040 (local address 127.11.93.190:36163)
0809 02:23:47.926129 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 02:23:47.926131 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 02:23:47.926139 (+ 8us) server_negotiation.cc:407] Connection header received
0809 02:23:47.926197 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:23:47.926198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:23:47.926248 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:23:47.926325 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:23:47.926506 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:47.927288 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:47.928408 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:23:47.928640 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:23:47.928705 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:23:47.928913 (+ 208us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:23:47.929026 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:23:47.929086 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 02:23:47.929242 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 02:23:47.929267 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":62,"threads_started":1}
I20260809 02:23:47.937024 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 3248
I20260809 02:23:47.944604 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 3327
I20260809 02:23:47.950353 11638 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskWEWZ6r/build/release/bin/kudu with pid 3404
2026-08-09T02:23:47Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2914 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5782 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (276195 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST